Feature Collapse Under Corruption: An Entropy Perspective on Robust Neural Networks
Even after decades of advances in neural network training, the inherent robustness challenge remains open. While the sensitivity to adversarial perturbations is understandable given their intentional learning, the most surprising fact is the vulnerability to natural corruptions. Moreover, the reason…