2026
Position: Let's Develop Data Probes to Fundamentally Understand How Data Affects LLM Performance
ICML 2026poster
Data is fundamental to large language models (LLMs). However, understanding of what makes certain data useful for different stages of an LLM workflow, including training, tuning, alignment, in-context learning, etc., and why, remains an open question. Current approaches rely heavily on extensive exp…