2025
Linear Decoding of Morphology Relations in Language Models (Student Abstract)
AAAI 2025technical
The recent success of transformer language models owes much to their conversational fluency, which includes linguistic and morphological proficiency. An affine Taylor approximation has been found to be a good approximation for transformer computations over certain factual and encyclopedic relations.…