Isaac Caswell — accepted AI-conference papers

2024

Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages

Daan van Esch, Sandy Ritchie, Sebastian Ruder, Julia Kreutzer, Clara Rivera, Ishank Saxena +1

COLING 2024main

Contrary to common belief, there are rich and diverse data sources available for many thousands of languages, which can be used to develop technologies for these languages. In this paper, we provide an overview of some of the major online data sources, the types of data that they provide access to,…

Cited by 0 Source ↗PDF ↗Scholar ↗

2020

Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus

Isaac Caswell, Theresa Breiner, Daan van Esch, Ankur Bapna

COLING 2020main

Large text corpora are increasingly important for a wide variety of Natural Language Processing (NLP) tasks, and automatic language identification (LangID) is a core technology needed to collect such datasets in a multilingual context. LangID is largely treated as solved in the literature, with mode…

Cited by 101 Source ↗PDF ↗code ↗Scholar ↗