Chenyi yang

BAME: Block-Aware Mask Evolution for Efficient N:M Sparse Training

N:M sparsity stands as a progressively important tool for DNN compression, achieving practical speedups by stipulating at most N non-zero components within M sequential weights. Unfortunately, most existing works identify the N:M sparse mask through dense backward propagation to update all weights,…