2022
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation
NAACL 2022long
Non-autoregressive neural machine translation (NAT) suffers from the multi-modality problem: the source sentence may have multiple correct translations, but the loss function is calculated only according to the reference sentence. Sequence-level knowledge distillation makes the target more determini…