Itamar Bar-Yossef — accepted AI-conference papers

2025

Transparent and Coherent Procedural Mistake Detection

Shane Storks, Itamar Bar-Yossef, Yayuan Li, Zheyuan Zhang, Jason J Corso, Joyce Chai

EMNLP 2025

Procedural mistake detection (PMD) is a challenging problem of classifying whether a human user (observed through egocentric video) has successfully executed a task (specified by a procedural text). Despite significant recent efforts, machine performance in the wild remains nonviable, and the reason

Cited by 0 Source ↗PDF ↗Scholar ↗

2023

Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?

Yuwei Bao, Keunwoo Peter Yu, Yichi Zhang, Shane Storks, Itamar Bar-Yossef, Alex de la Iglesia +3

EMNLP 2023long findings

Despite tremendous advances in AI, it remains a significant challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks. These systems need to have a sophisticated understanding of the user as well as the environment, and…

Cited by 0 Source ↗code ↗Scholar ↗