Continual Model Routing in Evolving Model Hubs
Jack Bell, Giacomo Carfì, Gerlando Gramaglia, Vincenzo Lomonaco
Abstract
AI model hubs provide access to a rapidly growing collection of powerful pre-trained models, enabling off-the-shelf mixture-of-experts systems with different routing strategies. However, this rapid growth poses two fundamental challenges: scaling model selection across thousands of experts and continually updating routing mechanisms as new models and tasks are introduced. In this paper, we formalise this setting as Continual Model Routing (CMR) and propose *CMRBench*, a new large-scale benchmark simulating realistic hub expansion and including over 2,000 candidate models. Finally, we introduce *CARvE*, a contrastive embedding approach for efficient continual model routing via domain-stratified coreset replay and checkpoint-based anchoring. Extensive empirical results and ablations show that CARvE significantly outperforms zero-shot retrieval, fine-tuning, and adapter-merging baselines in model, family, and domain-level accuracy.
BibTeX
@inproceedings{
bell2026continual,
title={Continual Model Routing in Evolving Model Hubs},
author={Jack Bell and Giacomo Carfi' and Gerlando Gramaglia and Vincenzo Lomonaco},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=IT7lA8t0S6}
}