← Search

Taehee Jeon

2 accepted papers

2025

Polishing Every Facet of the GEM: Testing Linguistic Competence of LLMs and Humans in Korean

ACL 2025long

We introduce the  ̲Korean  ̲Grammar  ̲Evaluation Bench ̲Mark (KoGEM), designed to assess the linguistic competence of LLMs and humans in Korean. KoGEM consists of 1.5k multiple-choice QA pairs covering five main categories and 16 subcategories. The zero-shot evaluation of 27 LLMs of various sizes an…