← Search

Virginie Do

9 accepted papers

2026

Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments

ICLR 2026oral

We introduce **Gaia2**, a benchmark for evaluating large language model agents in realistic, asynchronous environments. Unlike prior static or synchronous evaluations, Gaia2 introduces scenarios where environments evolve independently of agent actions, requiring agents to operate under temporal cons…

Cited by 0SourceScholar
2025

Robust LLM safeguarding via refusal feature adversarial training

ICLR 2025poster

Large language models (LLMs) are vulnerable to adversarial attacks that can elicit harmful responses. Defending against such attacks remains challenging due to the opacity of jailbreaking mechanisms and the high computational cost of training LLMs robustly. We demonstrate that adversarial attacks sh…

Cited by 9SourcePDFScholar
2023

Contextual bandits with concave rewards, and an application to fair ranking

ICLR 2023poster

We consider Contextual Bandits with Concave Rewards (CBCR), a multi-objective bandit problem where the desired trade-off between the rewards is defined by a known concave objective function, and the reward vector depends on an observed stochastic context. We present the first algorithm with provably…

Cited by 4SourcePDFScholar
2023

Online Certification of Preference-Based Fairness for Personalized Recommender Systems (Extended Abstract)

IJCAI 2023poster

Recommender systems are facing scrutiny because of their growing impact on the opportunities we have access to. Current audits for fairness are limited to coarse-grained parity assessments at the level of sensitive groups. We propose to audit for envy-freeness, a more granular criterion aligned with…

Cited by 0SourcePDFScholar
2022

Online Certification of Preference-Based Fairness for Personalized Recommender Systems

AAAI 2022technical

Recommender systems are facing scrutiny because of their growing impact on the opportunities we have access to. Current audits for fairness are limited to coarse-grained parity assessments at the level of sensitive groups. We propose to audit for envy-freeness, a more granular criterion aligned with…

Cited by 53SourcePDFScholar
2021

E-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks

ICCV 2021poster

Recently, there has been an increasing number of efforts to introduce models capable of generating natural language explanations (NLEs) for their predictions on vision-language (VL) tasks. Such models are appealing, because they can provide human-friendly and comprehensive explanations. However, the…

Cited by 111PDFcodeScholar
2021

Two-sided fairness in rankings via Lorenz dominance

NeurIPS 2021poster

We consider the problem of generating rankings that are fair towards both users and item producers in recommender systems. We address both usual recommendation (e.g., of music or movies) and reciprocal recommendation (e.g., dating). Following concepts of distributive justice in welfare economics, ou…

Cited by 60SourcePDFScholar