2026
Unraveling Syntax: Language Modeling and the Substructure of Grammars
ICML 2026spotlight
While large models achieve impressive results, their learning dynamics are far from understood. Many domains of interest -- such as natural language syntax, coding languages, arithmetic problems -- are captured by context-free grammars (CFGs). In this work, we extend prior work on neural language mo…