2024
DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers
NAACL 2024findings
In recent years, several interpretability methods have been proposed to interpret the inner workings of Transformer models at different levels of precision and complexity.In this work, we propose a simple but effective technique to analyze encoder-decoder Transformers. Our method, which we name Deco…