2022
Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence
NAACL 2022findings
The logical negation property (LNP), which implies generating different predictions for semantically opposite inputs (p is true iff ¬p is false), is an important property that a trustworthy language model must satisfy. However, much recent evidence shows that large-size pre-trained language models (…