2025
Principled Understanding of Generalization for Generative Transformer Models in Arithmetic Reasoning Tasks
ACL 2025long
Transformer-based models excel in various tasks but their generalization capabilities, especially in arithmetic reasoning, remain incompletely understood. Arithmetic tasks provide a controlled framework to explore these capabilities, yet performance anomalies persist, such as inconsistent effectiven…