← Search

Yuwei Bao

4 accepted papers

2023

Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?

EMNLP 2023long findings

Despite tremendous advances in AI, it remains a significant challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks. These systems need to have a sophisticated understanding of the user as well as the environment, and…

Cited by 0SourcecodeScholar
2023

Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition

ACL 2023long

Human language acquisition is an efficient, supervised, and continual process. In this work, we took inspiration from how human babies acquire their first language, and developed a computational process for word acquisition through comparative learning. Motivated by cognitive findings, we generated…

2022

DANLI: Deliberative Agent for Following Natural Language Instructions

EMNLP 2022main

Recent years have seen an increasing amount of work on embodied AI agents that can perform tasks by following human language instructions. However, most of these agents are reactive, meaning that they simply learn and imitate behaviors encountered in the training data. These reactive agents are insu…