2025
Unleashing the Power of Task-Specific Directions in Parameter Efficient Fine-tuning
ICLR 2025poster
Large language models demonstrate impressive performance on downstream tasks, yet requiring extensive resource consumption when fully fine-tuning all parameters. To mitigate this, Parameter Efficient Fine-Tuning (PEFT) strategies, such as LoRA, have been developed. In this paper, we delve into the…