Jin-Seong Choi

M-CTRL: A Continual Representation Learning Framework with Slowly Improving Past Pre-Trained Model

Representation models pre-trained on unlabeled data show competitive performance in speech recognition, even when fine-tuned on small amounts of labeled data. The continual representation learning (CTRL) framework combines pre-training and continual learning methods to obtain powerful representation…