Francesca Morandi

Distilling Linearized Behavior into Non-linear Fine-Tuning for Effective Task Arithmetic

Task vector composition has emerged as a promising paradigm for editing pre-trained models, enabling model merging via addition and task removal via subtraction. Fine-tuning in the tangent space of a pre-trained model (*linearized fine-tuning*) has proven particularly effective in this setting, as i…