Vima Gupta
PhD student, College of Computing, GaTech
About Me
I am a first year PhD student working on Systems for ML, in College of Computing at Georgia Institute of Technology. I am fortunate to be advised by Dr. Anand Iyer and Dr. Ada Gavrilovska. I am currently building robust systems for computationally expensive foundational models like LLMs. My ongoing projects and coursework are aligned towards creating a foundational understanding of distributed systems for large models.
Ongoing Research
- Optimizing inference latency for Mixture of Expert models by leveraging runtime information and kernel optimization
- Designing scheduling policies for speeding up LLM inference for lower latency request and while gaining higher throughput using speculative decoding.
- Exploring the qubit mapping, routing and scheduling problem for trapped-ion based quantum computers, with TINKER group under the supervision of Dr. Tom Conte. (Master’s thesis)
- Teaching neural networks how to count, under the guidance of Dr. Sashank Varma. Poster at CogSci’22! . Full paper accepted at CogSci’24
Experience
I am currently interning with Microsoft Research in the AI Frameworks team where I am enriching the existing hand-written kernels for LLM inference through systematic performance models.
During summer of 2022, I explored ML compiler frameworks for Cerebras Systems, where I had the opportunity to how make sparse attention faster on LLMs through MLIR transformation passes. Previously, I have co-founded PACE, a fitness startup with CREATE-X, aimed at remote physical therapy, leveraging deep learning and computer vision techniques.
Prior to my master’s, I was a Design Engineer at Arm where I worked on physical design implementation of high performance and low power design at the sub-system level for Arm V7-V9 cores (4nm, 5nm and 11nm) through floorplan co-design for big and little cores. During my undergrad, I also worked on foggy channel modelling for autonomous vehicles that led to Best Paper Award at IMICPW. You can find my resume here .
Interests and Hobbies
In my free time, I like to read on topics spanning mythology, psychology and ancient history. I am also huge TV show and movie buff and into casual quizzing.