ACL 2025finding0 citations

The Two Paradigms of LLM Detection: Authorship Attribution vs. Authorship Verification

Janek Bevendorff, Matti Wiegmann, Emmelie Richter, Martin Potthast, Benno Stein

Abstract

The detection of texts generated by LLMs has quickly become an important research problem. Many supervised and zero-shot detectors have already been proposed, yet their effectiveness and precision remain disputed. Current research therefore focuses on making detectors robust against domain shifts and on building corresponding benchmarks. In this paper, we show that the actual limitations hindering progress in LLM detection lie elsewhere: LLM detection is often implicitly modeled as an authorship attribution task, while its true nature is that of authorship verification. We systematically analyze the current research with respect to this misunderstanding, conduct an in-depth comparative analysis of the benchmarks, and validate our claim using state-of-the-art LLM detectors. Our contributions open the realm of authorship analysis technology for understanding and tackling the problem of LLM detection.

BibTeX
@inproceedings{bevendorff-etal-2025-two,
    title = "The Two Paradigms of {LLM} Detection: Authorship Attribution vs. Authorship Verification",
    author = "Bevendorff, Janek  and
      Wiegmann, Matti  and
      Richter, Emmelie  and
      Potthast, Martin  and
      Stein, Benno",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2025",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.findings-acl.194/",
    doi = "10.18653/v1/2025.findings-acl.194",
    pages = "3762--3787",
    ISBN = "979-8-89176-256-5"
}
The Two Paradigms of LLM Detection: Authorship Attribution vs. Authorship Verification · ACL 2025