2025
Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition
ICML 2025spotlight
Large Language Models (LLMs) have demonstrated remarkable in-context learning (ICL) capabilities. In this study, we explore a surprising phenomenon related to ICL: LLMs can perform multiple, computationally distinct ICL tasks simultaneously, during a single inference call, a capability we term task…