Jaïr A. Waal

Is a cute puyfred cute? Context-dependent form-meaning systematicity in LLMs

We investigate static and contextualized embeddings for English pseudowords across a variety of Large Language Models (LLMs), to study (i) how these models represent semantic attributes of strings they encounter for the very first time and how (ii) these representations interact with sentence contex…