An Item Response Theory Framework for Persuasion

Anastassia Kornilova; Vladimir Eidelman; Daniel Douglass

NAACL 2022findings2 citations

An Item Response Theory Framework for Persuasion

Anastassia Kornilova, Vladimir Eidelman, Daniel Douglass

Abstract

In this paper, we apply Item Response Theory, popular in education and political science research, to the analysis of argument persuasiveness in language. We empirically evaluate the model’s performance on three datasets, including a novel dataset in the area of political advocacy. We show the advantages of separating these components under several style and content representations, including evaluating the ability of the speaker embeddings generated by the model to parallel real-world observations about persuadability.

BibTeX

@inproceedings{kornilova-etal-2022-item,
    title = "An Item Response Theory Framework for Persuasion",
    author = "Kornilova, Anastassia  and
      Eidelman, Vladimir  and
      Douglass, Daniel",
    editor = "Carpuat, Marine  and
      de Marneffe, Marie-Catherine  and
      Meza Ruiz, Ivan Vladimir",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2022",
    month = jul,
    year = "2022",
    address = "Seattle, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.findings-naacl.7/",
    doi = "10.18653/v1/2022.findings-naacl.7",
    pages = "77--86"
}