Laetitia Frost

Differentiable Sparsity via $D$-Gating: Simple and Versatile Structured Penalization

Structured sparsity regularization offers a principled way to compact neural networks, but its non-differentiability breaks compatibility with conventional stochastic gradient descent and requires either specialized optimizers or additional post-hoc pruning without formal guarantees. In this work, w…