ICLR 2019poster118 citations

Stochastic Prediction of Multi-Agent Interactions from Partial Observations

Chen Sun, Per Karlsson, Jiajun Wu, Joshua B Tenenbaum, Kevin Murphy

Abstract

We present a method which learns to integrate temporal information, from a learned dynamics model, with ambiguous visual information, from a learned vision model, in the context of interacting agents. Our method is based on a graph-structured variational recurrent neural network, which is trained end-to-end to infer the current state of the (partially observed) world, as well as to forecast future states. We show that our method outperforms various baselines on two sports datasets, one based on real basketball trajectories, and one generated by a soccer game engine.

Dynamics modelingpartial observationsmulti-agent interactionspredictive models
BibTeX
@inproceedings{
sun2018predicting,
title={Predicting the Present and Future States of Multi-agent Systems from Partially-observed Visual Data},
author={Chen Sun and Per Karlsson and Jiajun Wu and Joshua B Tenenbaum and Kevin Murphy},
booktitle={International Conference on Learning Representations},
year={2019},
url={https://openreview.net/forum?id=r1xdH3CcKX},
}
Stochastic Prediction of Multi-Agent Interactions from Partial Observations · ICLR 2019