Seongmin Mun

Polysemy Interpretation and Transformer Language Models: A Case of Korean Adverbial Postposition -(u)lo

This study examines how Transformer language models utilise lexico-phrasal information to interpret the polysemy of the Korean adverbial postposition -(u)lo. We analysed the attention weights of both a Korean pre-trained BERT model and a fine-tuned version. Results show a general reduction in attent…