← Search

Cheolhyoung Lee

2 accepted papers

2020

Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models

ICLR 2020poster

In natural language processing, it has been observed recently that generalization could be greatly improved by finetuning a large-scale language model pretrained on a large unlabeled corpus. Despite its recent success and wide adoption, finetuning a large pretrained language model on a downstream ta…

Cited by 242SourcecodeScholar