Kaustubh S. Ponkshe
Researcher | AI Enthusiast | IIT Bombay Alumnus
Mohamed bin Zayed University of Artificial Intelligence
Abu Dhabi, UAE
Email: kaustubhponkshe@iitb.ac.in
About Me
I am Kaustubh Ponkshe, a researcher passionate about democratizing AI through trustworthy, efficient, and scalable machine learning systems. I hold a Bachelor’s degree in Electrical Engineering and a Master’s degree in Artificial Intelligence from IIT Bombay, where I was awarded the Undergraduate Research Award for one of the best bachelor’s theses. I am currently working as a researcher with Prof. Praneeth Vepakomma, as a part of the CERT-Lab at MBZUAI.
My research focuses on addressing challenges in fine-tuning, federated learning, and privacy-preserving AI. Some of my notable projects include:
- LoRA-SB: Achieved up to 90x parameter efficiency while maintaining competitive performance in fine-tuning.
- Power-Learning: Developed a privacy-preserving framework for collaborative learning with formal differential privacy guarantees.
- StructFormer: Proposed a novel structure-aware language model for document comprehension.
Feel free to explore my publications and projects.
Affiliations
- Researcher at Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi
- Former Research Intern at MIT Media Lab
- Former Graduate Student at IIT Bombay
Thank you for visiting my page!
news
| Jan 23, 2025 | GuideQ accepted at NAACL Findings  |
|---|---|
| Dec 15, 2024 | StructFormer accepted at the AAAI Workshop on Document Intelligence! |
| Dec 10, 2024 | Attending NeurIPS 2024 to present our work on Federated LoRA |
| Dec 01, 2024 | Our latest work LoRA-Silver Bullet is out on arxiv 😄 |
