2025
Unlocking SLM Potential for Data Analysis Code Generation via Non-Parametric Knowledge Distillation
NeurIPS 2025poster
Knowledge distillation from Large Language Models (LLMs) to locally hosted Small Language Models (SLMs) provides advantages for Data Analysis Code Generation (DACG) such as privacy protection. However, achieving effective distillation without resource-intensive training is challenging. This paper in…