2025
Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models
ICML 2025spotlight
Unsupervised pre-training and transfer learning are commonly used techniques to initialize training algorithms for neural networks, particularly in settings with limited labeled data. In this paper, we study the effects of unsupervised pre-training and transfer learning on the sample complexity of h…