On the Effectiveness of Partial Variance Reduction in Federated Learning With Heterogeneous Data
Data heterogeneity across clients is a key challenge in federated learning. Prior works address this by either aligning client and server models or using control variates to correct client model drift. Although these methods achieve fast convergence in convex or simple non-convex problems, the perfo…