Heyang Xu

How Do Your Code LLMs perform? Empowering Code Instruction Tuning with Really Good Data

Recently, there has been a growing interest in studying how to construct better code instruction tuning data. However, we observe Code models trained with these datasets exhibit high performance on HumanEval but perform worse on other benchmarks such as LiveCodeBench. Upon further investigation, we…