Kwangmin Ki

When to Ensemble: Identifying Token-Level Points for Stable and Fast LLM Ensembling

Ensembling Large Language Models (LLMs) has gained attention as a promising approach to surpass the performance of individual models by leveraging their complementary strengths. In particular, aggregating models’ next-token probability distributions to select the next token has been shown to be effe…