Bulat Khaertdinov

I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue

In face-to-face interaction, we use multiple modalities, including speech and gestures, to communicate information and resolve references to objects. However, how representational co-speech gestures refer to objects remains understudied from a computational perspective. In this work, we address this…