2026
Energy-Based Transformers are Scalable Learners and Thinkers
ICLR 2026oral
Inference-time computation, analogous to human System 2 Thinking, has recently become popular for improving model performance. However, most existing approaches suffer from several limitations: they are modality-specific (e.g., working only in text), problem-specific (e.g., verifiable domains like m…