Imitation Beyond Expectation Using Pluralistic Stochastic Dominance
Ali Farajzadeh, Danyal Saeed, Syed M Abbas, Rushit N. Shah, Aadirupa Saha, Brian D Ziebart
Abstract
Imitation learning seeks policies reflecting the values of demonstrated behaviors. Prevalent approaches learn to match or exceed the demonstrator's performance in expectation without knowing the demonstrator’s reward function. Unfortunately, this does not induce pluralistic imitators that learn to support qualitatively distinct demonstrations. We reformulate imitation learning using stochastic dominance over the demonstrations' reward distribution across a range of reward functions as our foundational aim. Our approach matches imitator policy samples (or support) with demonstrations using optimal transport theory to define an imitation learning objective over trajectory pairs. We demonstrate the benefits of pluralistic stochastic dominance (PSD) for imitation in both theory and practice.
BibTeX
@inproceedings{
farajzadeh2025imitation,
title={Imitation Beyond Expectation Using Pluralistic Stochastic Dominance},
author={Ali Farajzadeh and Danyal Saeed and Syed M Abbas and Rushit N. Shah and Aadirupa Saha and Brian D Ziebart},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
year={2025},
url={https://openreview.net/forum?id=YX5DHa9OfX}
}