Learning Hierarchical Task Networks with Preferences from Unannotated Demonstrations
Kevin Chen, Nithin Shrivatsav Srikanth, David Kent, Harish Ravichandar, Sonia Chernova
Abstract
We address the problem of learning Hierarchical Task Networks (HTNs) from unannotated task demonstrations, while retaining action execution preferences present in the demonstration data. We show that the problem of learning a complex HTN structure can be made analogous to the problem of series/parallel reduction of resistor networks, a foundational concept in Electrical Engineering. Based on this finding, we present the CircuitHTN algorithm, which constructs an action graph representing the demonstrations, and then reduces the graph following rules for reducing combination electrical circuits. Evaluation on real-world household kitchen tasks shows that CircuitHTN outperforms prior work in task structure and preference learning, successfully handling large data sets and exhibiting similar action selection preferences as the demonstrations.
BibTeX
@inproceedings{corl2020_learninghierarch,
title = {Learning Hierarchical Task Networks with Preferences from Unannotated Demonstrations},
author = {Kevin Chen and Nithin Shrivatsav Srikanth and David Kent and Harish Ravichandar and Sonia Chernova},
booktitle = {CoRL 2020},
year = {2020}
}