Petr Zadrazil

Low-Rank Gradient Approximation for Memory-Efficient on-Device Training of Deep Neural Network

Training machine learning models on mobile devices has the potential of improving both privacy and accuracy of the models. However, one of the major obstacles to achieving this goal is the memory limitation of mobile devices. Reducing training memory enables models with high-dimensional weight matri…