← Search

William Timkey

2 accepted papers

2023

A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing

EMNLP 2023long findings

Two of the central factors believed to underpin human sentence processing difficulty are expectations and retrieval from working memory. A recent attempt to create a unified cognitive model integrating these two factors have relied on the parallels between the self-attention mechanism of transformer…

Cited by 0SourceScholar
2021

All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

EMNLP 2021main

Similarity measures are a vital tool for understanding how language models represent and process language. Standard representational similarity measures such as cosine similarity and Euclidean distance have been successfully used in static word embedding models to understand how words cluster in sem…