Francesco Bonacci

Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale

Large language models (LLMs) show potential as computer agents, enhancing productivity and software accessibility in multi-modal tasks. However, measuring agent performance in sufficiently realistic and complex environments becomes increasingly challenging as: (i) most benchmarks are limited to sp…