LIU XUANHUANG

COBRA: Contribution-Based Bayesian Rank Allocation for Parameter-Efficient Fine-Tuning

Full fine-tuning of large language models (LLMs) incurs prohibitive computational and storage costs. Parameter-efficient fine-tuning (PEFT) addresses this limitation, with Low-Rank Adaptation (LoRA) gaining widespread adoption due to its simplicity and zero inference overhead. However, LoRA and its …