2020
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
COLING 2020main
BERT is a cutting-edge language representation model pre-trained by a large corpus, which achieves superior performances on various natural language understanding tasks. However, a major blocking issue of applying BERT to online services is that it is memory-intensive and leads to unsatisfactory lat…