Saeed Rashidi

Efficient Distributed Inference of Deep Neural Networks via Restructuring and Pruning

In this paper, we consider the parallel implementation of an already-trained deep model on multiple processing nodes (a.k.a. workers). Specifically, we investigate as to how a deep model should be divided into several parallel sub-models, each of which is executed efficiently by a worker. Since late…