2025
Measuring Fingerprints of Web-filtered Text Datasets and Fingerprint Propagation Through Training
NeurIPS 2025spotlight
We investigate fingerprints in pretraining datasets for large language models (LLMs) through dataset classification experiments. Building on prior work demonstrating the existence of fingerprints or biases in popular computer vision datasets, we analyze popular open-source pretraining datasets for L…