2022
Exploring Heterogeneous Characteristics of Layers in ASR Models for More Efficient Training
ICASSP 2022accepted
Transformer-based architectures have been the subject of research aimed at understanding their overparameterization and the non-uniform importance of their layers. Applying these approaches to Automatic Speech Recognition, we demonstrate that the state-of-the-art Conformer models generally have mult…