Tim Van de Cruys

How Relevant Are Selectional Preferences for Transformer-based Language Models?

Selectional preference is defined as the tendency of a predicate to favor particular arguments within a certain linguistic context, and likewise, reject others that result in conflicting or implausible meanings. The stellar success of contextual word embedding models such as BERT in NLP tasks has le…