Quanyu Zhang

Stabilizing Feature Geometry in Noisy Pretrained Models for Robust Downstream Tasks

Pretraining on large-scale data followed by fine-tuning has become a standard paradigm for visual models. However, noise in the pretraining data can be absorbed by the model and carried into downstream tasks, causing catastrophic inheritance. Prior studies mainly link this issue to changes in the fe