2026
“The Whole Is Greater than the Sum of Its Parts”: A Compatibility-Aware Multi-Teacher CoT Distillation Framework
IJCAI 2026
Chain-of-Thought (CoT) reasoning empowers Large Language Models (LLMs) with remarkable capabilities but typically requires prohibitive parameter scales. CoT distillation has emerged as a promising paradigm to transfer reasoning prowess into compact Student Models (SLMs), but existing approaches ofte