Ninghui Rao

Scalable Data Synthesis through Human-like Cognitive Imitation and Data Recombination

Large language models (LLMs) rely on massive amounts of training data, however, the quantity of empirically observed data is limited. To alleviate this issue, lots of LLMs leverage synthetic data to enhance the quantity of training data. Despite significant advancements in LLMs, the efficiency and s