2023
Diffused Redundancy in Pre-trained Representations
NeurIPS 2023poster
Representations learned by pre-training a neural network on a large dataset are increasingly used successfully to perform a variety of downstream tasks. In this work, we take a closer look at how features are encoded in such pre-trained representations. We find that learned representations in a give…