Maria Mihaela Trusca

Sequence-to-Sequence Spanish Pre-trained Language Models

In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures. While Spanish language models based on BERT and GPT have demonstrated proficiency in…