2025
DUO: No Compromise to Accuracy Degradation
NeurIPS 2025poster
Distributed training often suffers from high communication overhead due to large-scale gradient synchronization. Although gradient compression—particularly at 4-bit or even lower precision—significantly reduces transfer volume, it typically results in sacrifice in precision and degradation of the fi…