Hossain Shaikh Saadi

Improving Low-Resource Languages in Pre-Trained Multilingual Language Models

Pre-trained multilingual language models are the foundation of many NLP approaches, including cross-lingual transfer solutions. However, languages with small available monolingual corpora are often not well-supported by these models leading to poor performance. We propose an unsupervised approach to…