Nicholas Wilson

Unlocking SLM Potential for Data Analysis Code Generation via Non-Parametric Knowledge Distillation

Knowledge distillation from Large Language Models (LLMs) to locally hosted Small Language Models (SLMs) provides advantages for Data Analysis Code Generation (DACG) such as privacy protection. However, achieving effective distillation without resource-intensive training is challenging. This paper in…