2024
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation
NeurIPS 2024poster
Parameter-Efficient Fine-Tuning (PEFT) has become the standard for customising Foundation Models (FMs) to user-specific downstream tasks. However, typical PEFT methods require storing multiple task-specific adapters, creating scalability issues as these adapters must be housed and run at the FM serv…