2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
ACL 2023short
Fine-tuning large pre-trained language models on various downstream tasks with whole parameters is prohibitively expensive. Hence, Parameter-efficient fine-tuning has attracted attention that only optimizes a few task-specific parameters with the frozen pre-trained model. In this work, we focus on p…