2024
Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translation
EMNLP 2024finding
For crosslingual conversation and trade, Neural Machine Translation (NMT) is pivotal yet faces persistent challenges with monotony and repetition in generated content. Traditional solutions that rely on penalizing text redundancy or token reoccurrence have shown limited efficacy, particularly for le…