Guillaume Thomas

2 accepted papers

2022

Neural reality of argument structure constructions

Bai Li, Zining Zhu, Guillaume Thomas, Frank Rudzicz, Yang Xu

ACL 2022long

In lexicalist linguistic theories, argument structure is assumed to be predictable from the meaning of verbs. As a result, the verb is the primary determinant of the meaning of a clause. In contrast, construction grammarians propose that argument structure is encoded in constructions (or form-meanin…

Cited by 38 Source ↗PDF ↗code ↗Scholar ↗

2021

How is BERT surprised? Layerwise detection of linguistic anomalies

Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz

ACL 2021long

Transformer language models have shown remarkable ability in detecting when a word is anomalous in context, but likelihood scores offer no information about the cause of the anomaly. In this work, we use Gaussian models for density estimation at intermediate layers of three language models (BERT, Ro…

Cited by 38 Source ↗PDF ↗code ↗Scholar ↗