← Search

Kenneth Heafield

6 accepted papers

2024

Document-Level Machine Translation with Large-Scale Public Parallel Corpora

ACL 2024long

Despite the fact that document-level machine translation has inherent advantages over sentence-level machine translation due to additional information available to a model from document context, most translation systems continue to operate at a sentence level. This is primarily due to the severe lac…

2023

An Open Dataset and Model for Language Identification

ACL 2023short

Language identification (LID) is a fundamental step in many natural language processing pipelines. However, current LID systems are far from perfect, particularly on lower-resource languages. We present a LID model which achieves a macro-average F1 score of 0.93 and a false positive rate of 0.033% a…

2022

Cheat Codes to Quantify Missing Source Information in Neural Machine Translation

NAACL 2022long

This paper describes a method to quantify the amount of information H(t|s) added by the target sentence t that is not present in the source s in a neural machine translation system. We do this by providing the model the target sentence in a highly compressed form (a “cheat code”), and exploring the…

2022

Constrained Regeneration for Cross-Lingual Query-Focused Extractive Summarization

COLING 2022main

Query-focused summaries of foreign-language, retrieved documents can help a user understand whether a document is actually relevant to the query term. A standard approach to this problem is to first translate the source documents and then perform extractive summarization to find relevant snippets. H…

Cited by 3SourcePDFScholar
2021

Gender bias amplification during Speed-Quality optimization in Neural Machine Translation

ACL 2021short

Is bias amplified when neural machine translation (NMT) models are optimized for speed and evaluated on generic test sets using BLEU? We investigate architectures and techniques commonly used to speed up decoding in Transformer-based models, such as greedy search, quantization, average attention net…

Cited by 48SourcePDFScholar
2021

TranslateLocally: Blazing-fast translation running on the local CPU

EMNLP 2021system demonstrations

Every day, millions of people sacrifice their privacy and browsing habits in exchange for online machine translation. Companies and governments with confidentiality requirements often ban online translation or pay a premium to disable logging. To bring control back to the end user and demonstrate sp…