Naghmeh Ghanooni

Mitigating Spurious Features in Contrastive Learning with Spectral Regularization

Neural networks generally prefer simple and easy-to-learn features. When these features are spuriously correlated with the labels, the network's performance can suffer, particularly for underrepresented classes or concepts. Self-supervised representation learning methods, such as contrastive learnin…