Suyu Zhao

Collaborative Inference Acceleration with Non-Penetrative Tensor Partitioning

The inference of large-sized images on Internet of Things (IoT) devices is commonly hindered by limited resources, while there are often stringent latency requirements for Deep Neural Network (DNN) inference. Currently, this problem is generally addressed by collaborative inference, where the large-…