COLING 2022main2 citations

How about Time? Probing a Multilingual Language Model for Temporal Relations

Tommaso Caselli, Irene Dini, Felice Dell’Orletta

Abstract

This paper presents a comprehensive set of probing experiments using a multilingual language model, XLM-R, for temporal relation classification between events in four languages. Results show an advantage of contextualized embeddings over static ones and a detrimen- tal role of sentence level embeddings. While obtaining competitive results against state-of-the-art systems, our probes indicate a lack of suitable encoded information to properly address this task.

BibTeX
@inproceedings{caselli-etal-2022-time,
    title = "How about Time? Probing a Multilingual Language Model for Temporal Relations",
    author = "Caselli, Tommaso  and
      Dini, Irene  and
      Dell{'}Orletta, Felice",
    editor = "Calzolari, Nicoletta  and
      Huang, Chu-Ren  and
      Kim, Hansaem  and
      Pustejovsky, James  and
      Wanner, Leo  and
      Choi, Key-Sun  and
      Ryu, Pum-Mo  and
      Chen, Hsin-Hsi  and
      Donatelli, Lucia  and
      Ji, Heng  and
      Kurohashi, Sadao  and
      Paggio, Patrizia  and
      Xue, Nianwen  and
      Kim, Seokhwan  and
      Hahm, Younggyun  and
      He, Zhong  and
      Lee, Tony Kyungil  and
      Santus, Enrico  and
      Bond, Francis  and
      Na, Seung-Hoon",
    booktitle = "Proceedings of the 29th International Conference on Computational Linguistics",
    month = oct,
    year = "2022",
    address = "Gyeongju, Republic of Korea",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2022.coling-1.283/",
    pages = "3197--3209"
}
How about Time? Probing a Multilingual Language Model for Temporal Relations · COLING 2022