2026
The Geometry of Sequential Learning: Lie-Bracket Prediction of Transfer Order
ICML 2026poster
Sequential fine-tuning on multiple datasets is ubiquitous, but the training order of sources can measurably change downstream performance; testing both orders roughly doubles compute. We model a single gradient step on a dataset as a nonlinear operator and show that non-commutativity induces order-d…