2019
K for the Price of 1: Parameter-efficient Multi-task and Transfer Learning
ICLR 2019poster
We introduce a novel method that enables parameter-efficient transfer and multi-task learning with deep neural networks. The basic approach is to learn a model patch - a small set of parameters - that will specialize to each task, instead of fine-tuning the last layer or the entire network. For inst…