Jyoti Aneja

I am a Senior Researcher in the Physics of AGI group led by Sébastien Bubeck at Microsoft Research, Redmond.

I graduated with a PhD from the University of Illinois at Urbana-Champaign where I worked with Alex Schwing and also closely collaborated with David Forsyth.

My research interests lie at the intersection of Computer Vision, Deep Learning and Natural Language Processing.

In my (not so) past life, I was a physicist. I have a MS in Physics from UIUC.

If you're interested in working with me, get in touch via email.

E-Mail | CV | Google Scholar | Github | Twitter


[NEW] Textbooks Are All You Need
Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio C´esar Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, S´ebastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li


Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, John X. Morris, Jyoti Aneja, Alexander M. Rush, Jianfeng Gao
under submission


ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Houdong Hu, Zicheng Liu, Yong Jae Lee, Jianfeng Gao
Conference on Neural Information Processing Systems (NeurIPS) (Datasets and Benchmarks Track), 2022


A Contrastive Learning Approach for Training Variational Autoencoder Priors
Jyoti Aneja, Alexander Schwing, Jan Kautz, Arash Vahdat
Conference on Neural Information Processing Systems (NeurIPS), 2021


Image Captioning Diversity under the Radar
Xiaoming Zhao, Jyoti Aneja, Harsh Agrawal, Alexander Schwing
Under Submission


Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning
Jyoti Aneja*, Harsh Agrawal*, Dhruv Batra, Alexander Schwing
International Conference on Computer Vision (ICCV), 2019


Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech
Aditya Deshpande*, Jyoti Aneja*, Liwei Wang, Alexander Schwing, David Forsyth
Computer Vision and Pattern Recognition (CVPR), 2019
(Oral presentation)


Convolutional Image Captioning
Jyoti Aneja*, Aditya Deshpande*, Alexander Schwing
Computer Vision and Pattern Recognition (CVPR), 2018
video(CSL Student Conference-2018) | pdf | code

Sept 2021 One Paper accepted at NeurIPS 2021!
Sept 2021 Successfully defended my PhD thesis!
May 2021 Recognized as an "outstanding reviewer" at CVPR 2021
Dec 2020 Passed my Preliminary Exam! Thanks commitee members: Alex, Lana, David, Ben and Lance
June 2020 Starting Internship at NVIDIA Research, Santa Clara, California. I will be working with Arash Vahdat and Jan Kautz .
July 2019 Paper accepted at ICCV 2019.
June 2019 Our Team Schwail came 2nd in the TextVQA Challenge hosted at the VQA Workshop at CVPR 2019.
May 2019 Starting Internship at Microsoft Research, Redmond.
May 2019 Received Student Volunteer Award from CVF for CVPR 2019.
Feb 2019 Paper accepted at CVPR 2019 as oral presentation.
Feb 2019 Session chair, Artificial Intelligence in Action Session at CSL Student Conference 2019.
May 2018 Spending the Summer at Snap Research, LA.
April 2018 Awarded UIUC travel grant to present our paper at CVPR 2018.
Feb 2018 Paper accepted at CVPR 2018.

Template credits: Deepak, Jon, Saurabh, Unnat, Abhishek and Jeff