Elie Antoine — accepted AI-conference papers

2025

Part-Of-Speech Sensitivity of Routers in Mixture of Experts Models

Elie Antoine, Frederic Bechet, Phillippe Langlais

COLING 2025main

This study investigates the behavior of model-integrated routers in Mixture of Experts (MoE) models, focusing on how tokens are routed based on their linguistic features, specifically Part-of-Speech (POS) tags. The goal is to explore across different MoE architectures whether experts specialize in p…

Cited by 1 Source ↗PDF ↗Scholar ↗

2024

A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks

Elie Antoine, Frederic Bechet, Géraldine Damnati, Philippe Langlais

EMNLP 2024main

We introduce an evaluation methodology for reading comprehension tasks based on the intuition that certain examples, by the virtue of their linguistic complexity, consistently yield lower scores regardless of model size or architecture. We capitalize on semantic frame annotation for characterizing t…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗