genping wang*

Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer: A Disentangled Approach

"Recent works on parameter-efficient transfer learning (PETL) show the potential to adapt a pre-trained Vision Transformer to downstream recognition tasks with only a few learnable parameters. However, since they usually insert new structures into the pre-trained model, entire intermediate features…