Gerard Moreno-Torres Bertran

Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments

We introduce **Gaia2**, a benchmark for evaluating large language model agents in realistic, asynchronous environments. Unlike prior static or synchronous evaluations, Gaia2 introduces scenarios where environments evolve independently of agent actions, requiring agents to operate under temporal cons…