Alexandra Forsey-Smerek

Masked IRL: LLM-Guided Reward Disambiguation from Demonstrations and Language

Robots can adapt to user preferences by learning reward functions from demonstrations, but with limited data, reward models often overfit to spurious correlations and fail to generalize. This happens because demonstrations show robots how to do a task but not what matters for that task, causing the …