GR-LoRA: Gradient-Recycling Low-Rank Adaptation for Class-Incremental Learning
Pre-trained models with parameter-efficient fine-tuning have shown strong effectiveness in Class-Incremental Learning (CIL), which seeks to balance model plasticity and stability. In this context, orthogonality constraints can significantly enhance model stability, yet their reliance on subspace ine…