← Search

Samuel Coward

3 accepted papers

2025

BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games

ICLR 2025poster

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require handling intricate interactions, advanced spatial reasoning, l…

Cited by 9SourcePDFScholar
2024

Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning

ICML 2024spotlight

Benchmarks play a crucial role in the development and analysis of reinforcement learning (RL) algorithms. We identify that existing benchmarks used for research into open-ended learning fall into one of two categories. Either they are too slow for meaningful research to be performed without enormous…

2024

Refining Minimax Regret for Unsupervised Environment Design

ICML 2024poster

In unsupervised environment design, reinforcement learning agents are trained on environment configurations (levels) generated by an adversary that maximises some objective. Regret is a commonly used objective that theoretically results in a minimax regret (MMR) policy with desirable robustness guar…