← Search

Thomas Sommariva

2 accepted papers

2026

Dataless Weight Disentanglement in Task Arithmetic via Kronecker-Factored Approximate Curvature

ICLR 2026poster

Task Arithmetic yields a modular, scalable way to adapt foundation models. Combining multiple task vectors, however, can lead to cross-task interference, causing representation drift and degraded performance. Representation drift regularization provides a natural remedy to disentangle task vectors;…

Cited by 0SourceScholar
2026

Distilling Linearized Behavior into Non-linear Fine-Tuning for Effective Task Arithmetic

ICML 2026poster

Task vector composition has emerged as a promising paradigm for editing pre-trained models, enabling model merging via addition and task removal via subtraction. Fine-tuning in the tangent space of a pre-trained model (*linearized fine-tuning*) has proven particularly effective in this setting, as i…

Cited by 0SourceScholar