Katsuyuki Nakamura

Jointly Learning Energy Expenditures and Activities Using Egocentric Multimodal Signals

Physiological signals such as heart rate can provide valuable information about an individual's state and activity. However, existing work on computer vision has not yet explored leveraging these signals to enhance egocentric video understanding. In this work, we propose a model for reasoning on mul…