2025
Predicting Through Generation: Why Generation Is Better for Prediction
ACL 2025long
This paper argues that generating output tokens is more effective than using pooled representations for prediction tasks because token-level generation retains more mutual information. Since LLMs are trained on massive text corpora using next-token prediction, generation aligns naturally with their…