Yufeng Cai

GBA: A Tuning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Models

High-concurrency asynchronous training upon parameter server (PS) architecture and high-performance synchronous training upon all-reduce (AR) architecture are the most commonly deployed distributed training modes for recommendation models. Although synchronous AR training is designed to have higher…