2024
Learning to Route Among Specialized Experts for Zero-Shot Generalization
ICML 2024poster
Recently, there has been a widespread proliferation of "expert" language models that are specialized to a specific task or domain through parameter-efficient fine-tuning. How can we recycle large collections of expert language models to improve zero-shot generalization to unseen tasks? In this work,…