2021
Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation
NAACL 2021long
Successful methods for unsupervised neural machine translation (UNMT) employ cross-lingual pretraining via self-supervision, often in the form of a masked language modeling or a sequence generation task, which requires the model to align the lexical- and high-level representations of the two languag…