Bolin Lai* — accepted AI-conference papers

2024

LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

Bolin Lai*, Xiaoliang Dai, Lawrence Chen, Guan Pang, James M Rehg, Miao Liu

ECCV 2024oral

"Generating instructional images of human daily actions from an egocentric viewpoint serves as a key step towards efficient skill transfer. In this paper, we introduce a novel problem – egocentric action frame generation. The goal is to synthesize an image depicting an action in the user’s context (…

Cited by 15 Source ↗PDF ↗code ↗Scholar ↗

2024

Listen to Look into the Future: Audio-Visual Egocentric Gaze Anticipation

Bolin Lai*, Fiona Ryan, Wenqi Jia, Miao Liu, James M Rehg

ECCV 2024poster

"Egocentric gaze anticipation serves as a key building block for the emerging capability of Augmented Reality. Notably, gaze behavior is driven by both visual cues and audio signals during daily activities. Motivated by this observation, we introduce the first model that leverages both the video and…

Cited by 8 Source ↗PDF ↗code ↗Scholar ↗