Helena Merker

Robots That Know What to Ask: Recovering Misaligned Rewards through Targeted Explanations

Learning reward functions from demonstrations assumes that demonstrations provide adequate supervision over all features—or task-relevant aspects of behavior. In practice, demonstrations are often imperfect: humans may under-emphasize certain features due to cognitive load or physical difficulty, or…