← Search

Sunny Panchal

6 accepted papers

2026

Can Vision-Language Models Answer Face to Face Questions in the Real-World?

ICLR 2026poster

AI models have made significant strides in recent years in their ability to describe and answer questions about real-world images. They have also made progress in the ability to converse with users in real-time using audio input. This raises the question: have we reached the point where AI models, c…

Cited by 0SourceScholar
2026

Enhancing Hallucination Detection through Noise Injection

ICLR 2026poster

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked hallucinations to model uncertainty, suggesting that hallucinations…

Cited by 0SourceScholar
2025

Can Multi-Modal LLMs Provide Live Step-by-Step Task Guidance?

NeurIPS 2025poster

Multi-modal Large Language Models (LLM) have advanced conversational abilities but struggle with providing live, interactive step-by-step guidance, a key capability for future AI assistants. Effective guidance requires not only delivering instructions but also detecting their successful execution, a…

Cited by 0SourcecodeScholar
2024

Look, Remember and Reason: Grounded Reasoning in Videos with Language Models

ICLR 2024poster

Multi-modal language models (LM) have recently shown promising performance in high-level reasoning tasks on videos. However, existing methods still fall short in tasks like causal or compositional spatiotemporal reasoning over actions, in which model predictions need to be grounded in fine-grained…

Cited by 18SourcePDFScholar
2024

What to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interaction

NeurIPS 2024poster

Vision-language models have shown impressive progress in recent years. However, existing models are largely limited to turn-based interactions, where each turn must be stepped (i.e., prompted) by the user. Open-ended, asynchronous interactions, where an AI model may proactively deliver timely respon…