Shuai Kyle Zheng

PROFIT: A Specialized Optimizer for Deep Fine Tuning

The fine-tuning of pre-trained models has become ubiquitous in generative AI, computer vision, and robotics. Although much attention has been paid to improving the efficiency of fine-tuning model, there has been less scholarship around fine-tuning specifically for improved model performance. To reme…