Thanh-Nhi Nguyen

Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Models

Large Language Models (LLMs) excel in zero-shot and few-shot tasks, but achieving similar performance with encoder-only models like BERT and RoBERTa has been challenging due to their architecture. However, encoders offer advantages such as lower computational and memory costs. Recent work adapts the…