2025
Learning Task-Agnostic Representations through Multi-Teacher Distillation
Philippe Formont, Maxime DARRIN, Banafsheh Karimian, Eric Granger, Jackie CK Cheung, Ismail Ben Ayed +2
NeurIPS 2025poster
Casting complex inputs into tractable representations is a critical step across various fields. Diverse embedding models emerge from differences in architectures, loss functions, input modalities and datasets, each capturing unique aspects of the input. Multi-teacher distillation leverages this dive…