2025
MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space
ACL 2025finding
Data quality and diversity are key to the construction of effective instruction-tuning datasets. With the increasing availability of open-source instruction-tuning datasets, it is advantageous to automatically select high-quality and diverse subsets from a vast amount of data. Existing methods typic…