2026
Unifying Stacking and Cascading for Efficient Ensemble Inference
ICML 2026poster
We introduce LazyStack, a method for efficient model ensemble inference. The core idea is intuitive: after each model executes, we check whether accumulated evidence is sufficient to exit confidently. Sometimes one model suffices; other times we aggregate predictions from several models via trained …