Learning Diverse Policies in MOBA Games via Macro-Goals
Yiming Gao, Bei Shi, Xueying Du, Liang Wang, Guangwei Chen, Zhenjie Lian, Fuhao Qiu, GUOAN HAN
Abstract
Recently, many researchers have made successful progress in building the AI systems for MOBA-game-playing with deep reinforcement learning, such as on Dota 2 and Honor of Kings. Even though these AI systems have achieved or even exceeded human-level performance, they still suffer from the lack of policy diversity. In this paper, we propose a novel Macro-Goals Guided framework, called MGG, to learn diverse policies in MOBA games. MGG abstracts strategies as macro-goals from human demonstrations and trains a Meta-Controller to predict these macro-goals. To enhance policy diversity, MGG samples macro-goals from the Meta-Controller prediction and guides the training process towards these goals. Experimental results on the typical MOBA game Honor of Kings demonstrate that MGG can execute diverse policies in different matches and lineups, and also outperform the state-of-the-art methods over 102 heroes.
BibTeX
@inproceedings{
gao2021learning,
title={Learning Diverse Policies in {MOBA} Games via Macro-Goals},
author={Yiming Gao and Bei Shi and Xueying Du and Liang Wang and Guangwei Chen and Zhenjie Lian and Fuhao Qiu and GUOAN HAN and Weixuan Wang and Deheng Ye and QIANG FU and Yang Wei and Lanxiao Huang},
booktitle={Advances in Neural Information Processing Systems},
editor={A. Beygelzimer and Y. Dauphin and P. Liang and J. Wortman Vaughan},
year={2021},
url={https://openreview.net/forum?id=xVs5d5ZSWaa}
}