2026
TiTok: Transfer Token-level Knowledge via Contrastive Excess to Transplant LoRA
ICLR 2026poster
Large Language Models (LLMs) are widely applied in real world scenarios, but fine-tuning them comes with significant computational and storage costs. Parameter-Efficient Fine-Tuning (PEFT) methods such as LoRA mitigate these costs, but the adapted parameters are dependent on the base model and canno…