Sean O’Brien

Linear Layer Extrapolation for Fine-Grained Emotion Classification

Certain abilities of Transformer-based language models consistently emerge in their later layers. Previous research has leveraged this phenomenon to improve factual accuracy through self-contrast, penalizing early-exit predictions based on the premise that later-layer updates are more factually reli…