← Search

Juan Claude Formanek

4 accepted papers

2025

Breaking the Performance Ceiling in Reinforcement Learning requires Inference Strategies

NeurIPS 2025oral

Reinforcement learning (RL) systems have countless applications, from energy-grid management to protein design. However, such real-world scenarios are often extremely difficult, combinatorial in nature, and require complex coordination between multiple agents. This level of complexity can cause even…

Cited by 0SourceScholar
2025

Oryx: a Scalable Sequence Model for Many-Agent Coordination in Offline MARL

NeurIPS 2025poster

A key challenge in offline multi-agent reinforcement learning (MARL) is achieving effective many-agent multi-step coordination in complex environments. In this work, we propose Oryx, a novel algorithm for offline cooperative MARL to directly address this challenge. Oryx adapts the recently proposed…

Cited by 0SourceScholar
2025

Sable: a Performant, Efficient and Scalable Sequence Model for MARL

ICML 2025poster

As multi-agent reinforcement learning (MARL) progresses towards solving larger and more complex problems, it becomes increasingly important that algorithms exhibit the key properties of (1) strong performance, (2) memory efficiency, and (3) scalability. In this work, we introduce Sable, a performant…

2024

Dispelling the Mirage of Progress in Offline MARL through Standardised Baselines and Evaluation

NeurIPS 2024poster

Offline multi-agent reinforcement learning (MARL) is an emerging field with great promise for real-world applications. Unfortunately, the current state of research in offline MARL is plagued by inconsistencies in baselines and evaluation protocols, which ultimately makes it difficult to accurately a…