Probability Distribution Collapse: A Critical Bottleneck to Compact Unsupervised Neural Grammar Induction
Unsupervised neural grammar induction aims to learn interpretable hierarchical structures from language data. However, existing models face an expressiveness bottleneck, often resulting in unnecessarily large yet underperforming grammars. We identify a core issue, *probability distribution collapse*