Olabanji Shonibare

Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition

Recent advances in machine learning have demonstrated that multi-modal pre-training can improve automatic speech recognition (ASR) performance compared to randomly initialized models, even when models are fine-tuned on uni-modal tasks. Existing multi-modal pre-training methods for the ASR task have…