Muhammad Qorib

Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?

The natural language processing field has been evolving around language models for the past few years, from the usage of n-gram language models for re-ranking, to transfer learning with encoder-only (BERT-like) language models, and finally to large language models (LLMs) as general solvers. LLMs are…