Shivam Adarsh

SIKeD: Self-guided Iterative Knowledge Distillation for Mathematical Reasoning

Large Language Models (LLMs) can transfer their reasoning skills to smaller models by teaching them to generate the intermediate reasoning process required to solve multistep reasoning tasks. While LLMs can accurately solve reasoning tasks through a variety of strategies, even without fine-tuning, s…