← Search

Patrick Lange

2 accepted papers

2023

Towards Credible Human Evaluation of Open-Domain Dialog Systems Using Interactive Setup

AAAI 2023technical

Evaluating open-domain conversation models has been an open challenge due to the open-ended nature of conversations. In addition to static evaluations, recent work has started to explore a variety of per-turn and per-dialog interactive evaluation mechanisms and provide advice on the best setup. In t…

2022

TEACh: Task-Driven Embodied Agents That Chat

AAAI 2022technical

Robots operating in human spaces must be able to engage in natural language interaction, both understanding and executing instructions, and using conversation to resolve ambiguity and correct mistakes. To study this, we introduce TEACh, a dataset of over 3,000 human-human, interactive dialogues to c…