Ehsan Ardehaly

SliceFine: The Universal Winning-Slice Hypothesis for Pretrained Networks

This paper presents a theoretical framework that explains why fine-tuning small, randomly selected subnetworks (slices) within pre-trained models is sufficient for downstream adaptation. We prove that pretrained networks exhibit a universal winning slice property, arising from two phenomena: (1) spe…