Yuan Peng

FusedRec: Fused Embedding Communication for Distributed Recommendation Training on GPUs

Recent years have witnessed the wide adoption of deep learning recommendation models (DLRMs) for many online services. Unlike traditional DNN training, DLRMs leverage massive embeddings to represent sparse features, which are stored in distributed GPUs following the model parallel paradigm. Existing