Publications

SemIE: Semantically-aware Image Extrapolation

We propose a semantically-aware novel paradigm to perform image extrapolation that enables the addition of new object instances. All previous methods are limited in their capability of extrapolation to merely extending the already existing objects in the image. However, our proposed approach focuses not only on (i) extending the already present objects but also on (ii) adding new objects in the extended region based on the context. To this end, for a given image, we first obtain an object segmentation map using a state-of-the-art semantic segmentation method. The, thus, obtained segmentation map is fed into a network to compute the extrapolated semantic segmentation and the corresponding panoptic segmentation maps. The input image and the obtained segmentation maps are further utilized to generate the final extrapolated image. We conduct experiments on Cityscapes and ADE20K-bedroom datasets and show that our method outperforms all baselines in terms of FID, and similarity in object co-occurrence statistics.

Humor@IITK at SemEval-2021 Task 7: Language Models for Quantifying Humor & Offensiveness

Humor and Offense are highly subjective due to multiple word senses, cultural knowledge, and pragmatic competence. Hence, accurately detecting humorous and offensive texts has several compelling use cases in Recommendation Systems and Personalized Content Moderation. However, due to the lack of an extensive labeled dataset, most prior works in this domain haven't explored large neural models for subjective humor understanding. This paper explores whether large neural models and their ensembles can capture the intricacies associated with humor/offense detection and rating. Our experiments on the SemEval-2021 Task 7: HaHackathon show that we can develop reasonable humor and offense detection systems with such models. Our models are ranked third in subtask 1b and consistently ranked around the top 33% of the leaderboard for the remaining subtasks.

Work Experience

 
 
 
 
 

Member of Technical Staff

Adobe Systems, India

Jul 2021 - Present Noida, India
  • Working on Accessibility features of Acrobat and Reader
 
 
 
 
 

Research Intern

Adobe Research, India

May 2020 - Aug 2020 Bangalore, India
  • Developed a GAN based image synthesis pipeline to extrapolate an image along its periphery
  • Extensive literature review and solution analysis, to generate state-of-the-art Image out-painting results
  • Developed on SPADE architecture; our model adds new objects to the outpainted region, unlike existing image out-painting techniques
  • Developed a flask based web application to demonstrate the performance of the model
  • Paper got published in ICCV-2021 (Tier-1 Computer Vision conference)

Accomplish­ments

Academic Excellence Award

Academic Excellence Award for meritorious performance, IIT Kanpur (top 10% of batch)

All India Rank 144

  • Achieved a rank of 144 out of 200,000 candidates
  • JEE Advanced is an entrance exam to get admission into IITs, the premier engineering institutes in India, with a selection percentage of only 5%

All India Rank 163

  • Achieved a rank of 163 out of 1,200,000 candidates
  • JEE Main is a preliminary exam to get qualified for JEE Advanced

All India Rank 474

KVPY is a highly prestigious National Fellowship awarded by the Indian Institute of Science, Bangalore and Government of India to students who show high aptitude in research