← Search

Antoine Cully

10 accepted papers

2025

From Tabula Rasa to Emergent Abilities: Discovering Robot Skills via Real-World Unsupervised Quality-Diversity

CoRL 2025poster

Autonomous skill discovery aims to enable robots to acquire diverse be-haviors without explicit supervision. Learning such behaviors directly on physical hardware remains challenging due to safety and data efficiency constraints. Existing methods, including Quality-Diversity Actor-Critic (QDAC), req…

Cited by 0SourceScholar
2025

OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Code

ICLR 2025poster

Open-ended and AI-generating algorithms aim to continuously generate and solve increasingly complex tasks indefinitely, offering a promising path toward more general intelligence. To accomplish this grand vision, learning must occur within a vast array of potential tasks. Existing approaches to auto…

2024

Beyond Expected Return: Accounting for Policy Reproducibility When Evaluating Reinforcement Learning Algorithms

AAAI 2024technical

Many applications in Reinforcement Learning (RL) usually have noise or stochasticity present in the environment. Beyond their impact on learning, these uncertainties lead the exact same policy to perform differently, i.e. yield different return, from one roll-out to another. Common evaluation proced…

Cited by 4SourcePDFScholar
2024

Quality-Diversity Actor-Critic: Learning High-Performing and Diverse Behaviors via Value and Successor Features Critics

ICML 2024poster

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to solve complex continuous control tasks. However, most approache…

2023

Efficient Learning of Locomotion Skills through the Discovery of Diverse Environmental Trajectory Generator Priors

ICRA 2023poster

Data-driven learning based methods have recently been particularly successful at learning robust locomotion controllers for a variety of unstructured terrains. Prior work has shown that incorporating good locomotion priors in the form of trajectory generators (TGs) is effective at efficiently learni…

Cited by 8SourceScholar
2023

Neuroevolution is a Competitive Alternative to Reinforcement Learning for Skill Discovery

ICLR 2023top-25%

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm for training neural policies to solve complex control tasks. However, these policies tend to be overfit to the exact specifications of the task and environment they were trained on, and thus do not perform well when conditions devia…

2022

Dynamics-Aware Quality-Diversity for Efficient Learning of Skill Repertoires

ICRA 2022poster

Quality-Diversity (QD) algorithms are powerful exploration algorithms that allow robots to discover large repertoires of diverse and high-performing skills. However, QD algorithms are sample inefficient and require millions of evaluations. In this paper, we propose Dynamics-Aware Quality-Diversity (…

Cited by 33SourceScholar