Pin Lv

ViLaS: Exploring the Effects of Vision and Language Context in Automatic Speech Recognition

Enhancing automatic speech recognition (ASR) performance by leveraging additional multimodal information has shown promising results in previous studies. However, most of these works have primarily focused on utilizing visual cues derived from human lip motions. In fact, context-dependent visual and…