Abderrahmane Ait gueni ssaid

Factual Knowledge Assessment of Language Models Using Distractors

Language models encode extensive factual knowledge within their parameters. The accurate assessment of this knowledge is crucial for understanding and improving these models. In the literature, factual knowledge assessment often relies on cloze sentences, which can lead to erroneous conclusions due…