2022
Learning sparse features can lead to overfitting in neural networks
NeurIPS 2022accept
It is widely believed that the success of deep networks lies in their ability to learn a meaningful representation of the features of the data. Yet, understanding when and how this feature learning improves performance remains a challenge: for example, it is beneficial for modern architectures train…