Gergely Becsó

The Structure of Relation Decoding Linear Operators in Large Language Models

This paper investigates the structure of linear operators introduced in Hernandez et al. [2023] that decode specific relational facts in transformer language models. We extend their single-relation findings to a collection of relations and systematically chart their organization. We show that such c…