Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective
Existing studies on self-supervised speech representation learning have focused on developing new training methods and applying pre-trained models for different applications. However, the quality of these models is often measured by the performance of different downstream tasks. How well the represe…