Georg Carle

Select to Think: Unlocking SLM Potential with Local Sufficiency

Small language models (SLMs) offer computational efficiency for scalable deployment, yet they often fall short of the reasoning capabilities exhibited by their larger counterparts (LLMs). To mitigate this gap, current approaches invoke an LLM to generate tokens at points of reasoning divergence, but…