Duarte Miguel Alves — accepted AI-conference papers

2026

Should We Still Pretrain Encoders with Masked Language Modeling?

Hippolyte Gisserot-Boukhlef, Nicolas Boizard, Manuel Faysse, Duarte Miguel Alves, Emmanuel Malherbe, Andre Martins +2

ICLR 2026poster

Learning high-quality text representations is fundamental to a wide range of NLP tasks. While encoder pretraining has traditionally relied on Masked Language Modeling (MLM), recent evidence suggests that decoder models pretrained with Causal Language Modeling (CLM) can be effectively repurposed as e…

Cited by 0 Source ↗Scholar ↗

2023

Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning

Duarte Miguel Alves, Nuno M Guerreiro, João Alves, José Pombal, Ricardo Rei, José G. C. de Souza +2

EMNLP 2023short findings

Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra post-processing due to overgeneration. Alternatives such as finetun…

Cited by 0 Source ↗Scholar ↗