IROS 2016poster105 citations

Introspective perception: Learning to predict failures in vision systems

Shreyansh Daftry, Sam Zeng, J. Andrew Bagnell, Martial Hebert

Abstract

As robots aspire for long-term autonomous operations in complex dynamic environments, the ability to reliably take mission-critical decisions in ambiguous situations becomes critical. This motivates the need to build systems that have situational awareness to assess how quali ed they are at that moment to make a decision. We call this self-evaluating capability as introspection. In this paper, we take a small step in this direction and propose a generic framework for introspective behavior in perception systems. Our goal is to learn a model to reliably predict failures in a given system, with respect to a task, directly from input sensor data. We present this in the context of vision-based autonomous MAV flight in outdoor natural environments, and show that it effectively handles uncertain situations.

BibTeX
@inproceedings{iros2016_introspectiveper,
  title = {Introspective perception: Learning to predict failures in vision systems},
  author = {Shreyansh Daftry and Sam Zeng and J. Andrew Bagnell and Martial Hebert},
  booktitle = {IROS 2016},
  year = {2016}
}
Introspective perception: Learning to predict failures in vision systems · IROS 2016