Excavation of Fragmented Rocks with Multi-modal Model-based Reinforcement Learning

Yifan Zhu; Liyang Wang; Liangjun Zhang

IROS 2022poster9 citations

Excavation of Fragmented Rocks with Multi-modal Model-based Reinforcement Learning

Abstract

This paper presents a multi-modal model-based reinforcement learning (MBRL) approach to the excavation of fragmented rocks, which are very challenging to model due to their highly variable sizes and geometries, and visual occlusions. A multi-modal recurrent neural network (RNN) learns the dynamics of bucket-terrain interaction from a small physical dataset, with a discrete set of motion primitives encoded with domain knowledge as the action space. Then a model predictive controller (MPC) tracks a global reference path using multi-modal feedback. We show that our RNN-based dynamics function achieves lower prediction errors compared to a feed-forward neural network baseline, and the MPC is able to significantly outperform manually designed strategies on such a challenging task.

BibTeX

@inproceedings{iros2022_excavationoffrag,
  title = {Excavation of Fragmented Rocks with Multi-modal Model-based Reinforcement Learning},
  author = {Yifan Zhu and Liyang Wang and Liangjun Zhang},
  booktitle = {IROS 2022},
  year = {2022}
}