← Search

Sameera Lanka

2 accepted papers

2021

GPT Perdetry Test: Generating new meanings for new words

NAACL 2021long

Human innovation in language, such as inventing new words, is a challenge for pretrained language models. We assess the ability of one large model, GPT-3, to process new words and decide on their meaning. We create a set of nonce words and prompt GPT-3 to generate their dictionary definitions. We fi…

2021

Studying word order through iterative shuffling

EMNLP 2021main

As neural language models approach human performance on NLP benchmark tasks, their advances are widely seen as evidence of an increasingly complex understanding of syntax. This view rests upon a hypothesis that has not yet been empirically tested: that word order encodes meaning essential to perform…