Anupam Pani

Gaze-VLM: Bridging Gaze and VLMs through Attention Regularization for Egocentric Understanding

Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-regularized framework that enhances VLMs for two key egocentric understanding tasks: fine-grained future event predictio…