Sounak Mondal*

Look Hear: Gaze Prediction for Speech-directed Human Attention

"For computer systems to effectively interact with humans using spoken language, they need to understand how the words being generated affect the users’ moment-by-moment attention. Our study focuses on the incremental prediction of attention as a person is seeing an image and hearing a referring exp…