← Search

Matthew O'Kelly

4 accepted papers

2026

Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators

ICRA 2026poster

Rapid progress in imitation learning, foundation models, and large-scale datasets has led to robot manipulation policies that generalize to a wide-range of tasks and environments. However, rigorous evaluation of these policies remains a challenge. Typically in practice, robot policies are often eval…

2022

Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula

CoRL 2022oral

ML-based motion planning is a promising approach to produce agents that exhibit complex behaviors, and automatically adapt to novel environments. In the context of autonomous driving, it is common to treat all available training data equally. However, this approach produces agents that do not perfor…

Cited by 21SourceScholar
2020

Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systems

NeurIPS 2020poster

Learning-based methodologies increasingly find applications in safety-critical domains like autonomous driving and medical robotics. Due to the rare nature of dangerous events, real-world testing is prohibitively expensive and unscalable. In this work, we employ a probabilistic approach to safety e…

Cited by 64SourcePDFScholar
2018

Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation

NeurIPS 2018poster

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the de facto evaluation environment, places the public in danger, and, due to the rare nature of accidents, will require billions of mi…