Zhouyang Hong

Grounding Conversational Robots on Vision Through Dense Captioning and Large Language Models

This work explores a novel approach to empowering robots with visual perception capabilities using textual descriptions. Our approach involves the integration of GPT-4 with dense captioning, enabling robots to perceive and interpret the visual world through detailed text-based descriptions. To asses…