Adam Ousherovitch

Learning to Extrapolate to New Tasks: A Relational Approach to Task Extrapolation

Modern learning systems excel at interpolation but struggle to generalize to unseen tasks outside the training distribution's support. This failure occurs even in simple settings, such as handling task parameters beyond the training range, and persists despite advances in foundation models. To this …