2024
Semantic Training Signals Promote Hierarchical Syntactic Generalization in Transformers
EMNLP 2024main
Neural networks without hierarchical biases often struggle to learn linguistic rules that come naturally to humans. However, neural networks are trained primarily on form alone, while children acquiring language additionally receive data about meaning. Would neural networks generalize more like huma…