2026
PCLR: Progressively Compressed LoRA for Multimodal Continual Instruction Tuning
ICLR 2026poster
Continual Instruction Tuning (CIT) enables Large Multimodal Models (LMMs) to rapidly adapt to new tasks without retraining, but it suffers from the catastrophic forgetting problem. By adding new branches, model extension provides a great idea to accommodate novel knowledge while causing huge memory…