Yizirui Fang

Pragmatic Embodied Spoken Instruction Following in Human-Robot Collaboration with Theory of Mind

Spoken language instructions are ubiquitous in agent collaboration. However, in real-world human-robot collaboration, following human spoken instructions can be challenging due to various speaker and environmental factors, such as background noise or mispronunciation. When faced with noisy auditory …