COLING 2022main6 citations

One Word, Two Sides: Traces of Stance in Contextualized Word Representations

Aina Garí Soler, Matthieu Labeau, Chloé Clavel

Abstract

The way we use words is influenced by our opinion. We investigate whether this is reflected in contextualized word embeddings. For example, is the representation of “animal” different between people who would abolish zoos and those who would not? We explore this question from a Lexical Semantic Change standpoint. Our experiments with BERT embeddings derived from datasets with stance annotations reveal small but significant differences in word representations between opposing stances.

BibTeX
@inproceedings{gari-soler-etal-2022-one,
    title = "One Word, Two Sides: Traces of Stance in Contextualized Word Representations",
    author = "Gar{\'i} Soler, Aina  and
      Labeau, Matthieu  and
      Clavel, Chlo{\'e}",
    editor = "Calzolari, Nicoletta  and
      Huang, Chu-Ren  and
      Kim, Hansaem  and
      Pustejovsky, James  and
      Wanner, Leo  and
      Choi, Key-Sun  and
      Ryu, Pum-Mo  and
      Chen, Hsin-Hsi  and
      Donatelli, Lucia  and
      Ji, Heng  and
      Kurohashi, Sadao  and
      Paggio, Patrizia  and
      Xue, Nianwen  and
      Kim, Seokhwan  and
      Hahm, Younggyun  and
      He, Zhong  and
      Lee, Tony Kyungil  and
      Santus, Enrico  and
      Bond, Francis  and
      Na, Seung-Hoon",
    booktitle = "Proceedings of the 29th International Conference on Computational Linguistics",
    month = oct,
    year = "2022",
    address = "Gyeongju, Republic of Korea",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2022.coling-1.347/",
    pages = "3950--3959"
}
One Word, Two Sides: Traces of Stance in Contextualized Word Representations · COLING 2022