Jianshang Kou

KNN-Instruct: Automatic Instruction Construction with K Nearest Neighbor Deduction

Supervised fine-tuning (SFT) is a critical procedure for aligning large language models. Despite its efficiency, the construction of SFT data often struggles with issues of quality, diversity, and scalability. Many existing methods, inspired by the Self-Instruct framework, typically generate synthet…