Daniil Ignatev

Disentangling the Roles of Representation and Selection in Data Pruning

Data pruning—selecting small but impactful subsets—offers a promising way to efficiently scale NLP model training. However, existing methods often involve many different design choices, which have not been systematically studied. This limits future developments. In this work, we decompose data pruni…