← Search

Carlos Mabrey

3 accepted papers

2025

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement

AAAI 2025technical

Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is crucial for identifying non-verbal interactions of group members. In conjunction with their verbal participation, this creat…

Cited by 1SourcePDFScholar
2025

TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues

NAACL 2025system demonstrations

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these multimodal inputs to determine the set of task-relevant propos…

Cited by 0SourcePDFScholar
2024

“Any Other Thoughts, Hedgehog?” Linking Deliberation Chains in Collaborative Dialogues

EMNLP 2024finding

Question-asking in collaborative dialogue has long been established as key to knowledge construction, both in internal and collaborative problem solving. In this work, we examine probing questions in collaborative dialogues: questions that explicitly elicit responses from the speaker’s interlocutors…

Cited by 3SourcePDFScholar