2025
Exploring morphology-aware tokenization: A case study on Spanish language modeling
EMNLP 2025
This paper investigates to what extent the integration of morphological information can improve subword tokenization and thus also language modeling performance. We focus on Spanish, a language with fusional morphology, where subword segmentation can benefit from linguistic structure. Instead of rel