Wangcheng Tao

Position: Exploring the Robustness of Pipeline-Parallelism-Based Decentralized Training

Modern machine learning applications increasingly demand greater computational resources for training large models. Decentralized training has emerged as an effective means to democratize this technology. However, the potential threats associated with this approach remain inadequately discussed, pos…