Shuaihe Liu

PILO: Principal Component-based Implicit Regularization with Low-rank Optimization for Robust Transfer Learning

Adapting large, adversarially pre-trained models to specialized domains via transfer learning is a promising path toward building secure AI systems. However, a critical challenge arises when fine-tuning on limited downstream data: models often suffer from catastrophic forgetting of robustness, where