← Search

Peiyu Chen

2 accepted papers

2022

Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition

ACL 2022long

Training Transformer-based models demands a large amount of data, while obtaining aligned and labelled data in multimodality is rather cost-demanding, especially for audio-visual speech recognition (AVSR). Thus it makes a lot of sense to make use of unlabelled unimodal data. On the other side, altho…