← Search

Yidong Huang

5 accepted papers

2026

Tracing the Emergence of Symbol Grounding in Multimodal Language Models

ICML 2026poster

Symbol grounding (Harnad, 1990) describes how symbols such as words acquire their meanings by connecting to real-world sensorimotor experiences. Recent work has shown preliminary evidence that grounding may emerge in (vision-)language models trained at scale without using explicit grounding objectiv…

Cited by 0SourceScholar
2024

DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences

IROS 2024poster

Recent advancements in foundation models (FMs) have unlocked new prospects in autonomous driving, yet the experimental settings of these studies are preliminary, oversimplified, and fail to capture the complexity of real-world driving scenarios in human environments. It remains under-explored whethe…

Cited by 20SourcecodeScholar
2024

Inversion-Free Image Editing with Language-Guided Diffusion Models

CVPR 2024poster

Despite recent advances in inversion-based editing text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance consistency with accuracy; 3) the lack of compatibility with e…

2023

CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation

NeurIPS 2023poster

Diffusion models (DMs) have enabled breakthroughs in image synthesis tasks but lack an intuitive interface for consistent image-to-image (I2I) translation. Various methods have been explored to address this issue, including mask-based methods, attention-based methods, and image-conditioning. However…

2022

DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents

EMNLP 2022finding

In the real world, autonomous driving agents navigate in highly dynamic environments full of unexpected situations where pre-trained models are unreliable. In these situations, what is immediately available to vehicles is often only human operators. Empowering autonomous driving agents with the abil…