2026
High-Probability Convergence Guarantees of Decentralized SGD
ICML 2026poster
Convergence in high-probability (HP) has attracted increasing interest, due to implying exponentially decaying tail bounds and strong guarantees for individual runs of an algorithm. While many works study HP guarantees in centralized settings, much less is understood in the decentralized setup, wher…