Danil Sivtsov

Birch SGD: A Tree Graph Framework for Local and Asynchronous SGD Methods

We propose a new unifying framework, Birch SGD, for analyzing and designing distributed SGD methods. The central idea is to represent each method as a weighted directed tree, referred to as a computation tree. Leveraging this representation, we introduce a general theoretical result that reduces con…