Wang Yijing

Hit the Nail on the Head: Parameter-Efficient Multi-task Tuning via Human Language Intervention

Parameter-Efficient Fine-Tuning (PEFT) on small Pre-trained Language Models (PLMs) has emerged as a promising approach to enhance their multi-tasking capabilities. Prevalent methods simultaneously train additional modules (i.e., one task-shared module and multiple task-specific modules) for adapting…