2026
Vision Transformer Finetuning Benefits from Non-Smooth Components
ICML 2026poster
The smoothness of the transformer architecture has been extensively studied in the context of generalization, training stability, and adversarial robustness. However, its role in transfer learning remains poorly understood. In this paper, we analyze the ability of vision transformer components to ad…