Sophie Wang

The Truth Lies Somewhere in the Middle (of the Generated Tokens)

How should the sequence of hidden states produced during autoregressive generation be compressed into a representation that reflects the model’s internal state? We study representations derived from generated tokens and compare them to grounded embeddings across several domains. We find that pooling…