Charitha Rathnayake

Improving the Quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics

Parallel Data Curation (PDC) techniques aim to filter out noisy parallel sentences from web-mined corpora. Ranking sentence pairs using similarity scores on sentence embeddings derived from Pre-trained Multilingual Language Models (multiPLMs) is the most common PDC technique. However, previous resea