2025
Cross-Entropy Is All You Need To Invert the Data Generating Process
ICLR 2025oral
Supervised learning has become a cornerstone of modern machine learning, yet a comprehensive theory explaining its effectiveness remains elusive. Empirical phenomena, such as neural analogy-making and the linear representation hypothesis, suggest that supervised models can learn interpretable factor…