Haoyu Jin

SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures

Top-k sparsification method is popular and powerful forreducing the communication cost in Federated Learning(FL). However, according to our experimental observation, it spends most of the total communication cost on the index of the selected parameters (i.e., their position informa-tion), which is i…