2021
Frivolous Units: Wider Networks Are Not Really That Wide
AAAI 2021technical
A remarkable characteristic of overparameterized deep neural networks (DNNs) is that their accuracy does not degrade when the network width is increased. Recent evidence suggests that developing compressible representations allows the complexity of large networks to be adjusted for the learning task…