Miyu Goko

Task Success Prediction for Open-Vocabulary Manipulation Based on Multi-Level Aligned Representations

In this study, we consider the problem of predicting task success for open-vocabulary manipulation by a manipulator, based on instruction sentences and egocentric images before and after manipulation. Conventional approaches, including multimodal large language models (MLLMs), often fail to appropri…