2026
Following the Navigation: Enhancing Small Language Models Contextual Reasoning with LLM Guidance
ICLR 2026poster
Large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, excel in contextual reasoning by leveraging extensive world knowledge and deep contextual understanding. However, their high computational costs limit deployment in resource-constrained settings. Conversely, small language models (SLMs…