Shengwei Li — accepted AI-conference papers

2024

Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness

Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li, Xicheng Lu

NeurIPS 2024poster

Asynchronous stochastic gradient descent (ASGD) has evolved into an indispensable optimization algorithm for training modern large-scale distributed machine learning tasks. Therefore, it is imperative to explore the generalization performance of the ASGD algorithm. However, the existing results are…

Cited by 4 Source ↗PDF ↗Scholar ↗

2023

Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD

Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li

AAAI 2023technical

The generalization ability often determines the success of machine learning algorithms in practice. Therefore, it is of great theoretical and practical importance to understand and bound the generalization error of machine learning algorithms. In this paper, we provide the first generalization resul…

Cited by 19 Source ↗PDF ↗Scholar ↗