Susan Holm

ProMQA: Question Answering Dataset for Multimodal Procedural Activity Understanding

Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on traditional classification tasks, e.g., action recognition or temporal action localiza…