COLING 2025main1 citations

Exploring the Impact of Language Switching on Personality Traits in LLMs

Jacopo Amidei, Jose Gregorio Ferreira De Sá, Rubén Nieto Luna, Andreas Kaltenbrunner

Abstract

This paper investigates the extent to which LLMs align with humans when personality shifts are associated with language changes. Based on three experiments, that focus on GPT-4o and the Eysenck Personality Questionnaire-Revised (EPQR-A), our initial results reveal a weak yet significant variation in GPT-4o’s personality across languages, indicating that some stem from a language-switching effect rather than translation. Further analysis across five English-speaking countries shows that GPT-4o, leveraging stereotypes, reflects distinct country-specific personality traits.

BibTeX
@inproceedings{amidei-etal-2025-exploring,
    title = "Exploring the Impact of Language Switching on Personality Traits in {LLM}s",
    author = "Amidei, Jacopo  and
      Ferreira De S{\'a}, Jose Gregorio  and
      Luna, Rub{\'e}n Nieto  and
      Kaltenbrunner, Andreas",
    editor = "Rambow, Owen  and
      Wanner, Leo  and
      Apidianaki, Marianna  and
      Al-Khalifa, Hend  and
      Eugenio, Barbara Di  and
      Schockaert, Steven",
    booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
    month = jan,
    year = "2025",
    address = "Abu Dhabi, UAE",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.coling-main.162/",
    pages = "2370--2378"
}