2024
Attention Meets Post-hoc Interpretability: A Mathematical Perspective
ICML 2024poster
Attention-based architectures, in particular transformers, are at the heart of a technological revolution. Interestingly, in addition to helping obtain state-of-the-art results on a wide range of applications, the attention mechanism intrinsically provides meaningful insights on the internal behavio…