← Search

Xiluo He

2 accepted papers

2023

Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning

NeurIPS 2023poster

What role do augmentations play in contrastive learning? Recent work suggests that good augmentations are label-preserving with respect to a specific downstream task. We complicate this picture by showing that label-destroying augmentations can be useful in the foundation model setting, where the go…