← Search

Itziar Aldabe

3 accepted papers

2025

Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque

EMNLP 2025

Instructing language models with user intent requires large instruction datasets, which are only available for a limited set of languages. In this paper, we explore alternatives to conventional instruction adaptation pipelines in low-resource scenarios. We assume a realistic scenario for low-resourc

2024

Latxa: An Open Language Model and Evaluation Suite for Basque

ACL 2024long

We introduce Latxa, a family of large language models for Basque ranging from 7 to 70 billion parameters. Latxa is based on Llama 2, which we continue pretraining on a new Basque corpus comprising 4.3M documents and 4.2B tokens. Addressing the scarcity of high-quality benchmarks for Basque, we furth…

2022

Does Corpus Quality Really Matter for Low-Resource Languages?

EMNLP 2022main

The vast majority of non-English corpora are derived from automatically filtered versions of CommonCrawl. While prior work has identified major issues on the quality of these datasets (Kreutzer et al., 2021), it is not clear how this impacts downstream performance. Taking representation learning in…