COLING 2024main0 citations

Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages

Daan van Esch, Sandy Ritchie, Sebastian Ruder, Julia Kreutzer, Clara Rivera, Ishank Saxena, Isaac Caswell

Abstract

Contrary to common belief, there are rich and diverse data sources available for many thousands of languages, which can be used to develop technologies for these languages. In this paper, we provide an overview of some of the major online data sources, the types of data that they provide access to, potential applications of this data, and the number of languages that they cover. Even this covers only a small fraction of the data that exists; for example, printed books are published in many languages but few online aggregators exist.

BibTeX
@inproceedings{van-esch-etal-2024-connecting,
    title = "Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages",
    author = "van Esch, Daan  and
      Ritchie, Sandy  and
      Ruder, Sebastian  and
      Kreutzer, Julia  and
      Rivera, Clara  and
      Saxena, Ishank  and
      Caswell, Isaac",
    editor = "Calzolari, Nicoletta  and
      Kan, Min-Yen  and
      Hoste, Veronique  and
      Lenci, Alessandro  and
      Sakti, Sakriani  and
      Xue, Nianwen",
    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.lrec-main.331/",
    pages = "3729--3746"
}
Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages · COLING 2024