2024
Lower Bounds on the Expressivity of Recurrent Neural Language Models
NAACL 2024long
The recent successes and spread of large neural language models (LMs) call for a thorough understanding of their abilities. Describing their abilities through LMs’ representational capacity is a lively area of research. Investigations of the representational capacity of neural LMs have predominantly…