Learning Generalizable Device Placement Algorithms for Distributed Machine Learning

ravichandra addanki; Shaileshh Bojja Venkatakrishnan; Shreyan Gupta; Hongzi Mao; Mohammad Alizadeh

NeurIPS 2019poster2 citations

Learning Generalizable Device Placement Algorithms for Distributed Machine Learning

ravichandra addanki, Shaileshh Bojja Venkatakrishnan, Shreyan Gupta, Hongzi Mao, Mohammad Alizadeh

Abstract

We present Placeto, a reinforcement learning (RL) approach to efficiently find device placements for distributed neural network training.

BibTeX

@inproceedings{NEURIPS2019_71560ce9,
 author = {addanki, ravichandra and Bojja Venkatakrishnan, Shaileshh and Gupta, Shreyan and Mao, Hongzi and Alizadeh, Mohammad},
 booktitle = {Advances in Neural Information Processing Systems},
 editor = {H. Wallach and H. Larochelle and A. Beygelzimer and F. d\textquotesingle Alch\'{e}-Buc and E. Fox and R. Garnett},
 pages = {},
 publisher = {Curran Associates, Inc.},
 title = {Learning Generalizable Device Placement Algorithms for Distributed Machine Learning},
 url = {https://proceedings.neurips.cc/paper_files/paper/2019/file/71560ce98c8250ce57a6a970c9991a5f-Paper.pdf},
 volume = {32},
 year = {2019}
}