2022
BECEL: Benchmark for Consistency Evaluation of Language Models
COLING 2022main
Behavioural consistency is a critical condition for a language model (LM) to become trustworthy like humans. Despite its importance, however, there is little consensus on the definition of LM consistency, resulting in different definitions across many studies. In this paper, we first propose the ide…