Rhongho Jang

AttCAT: Explaining Transformers via Attentive Class Activation Tokens

Transformers have improved the state-of-the-art in various natural language processing and computer vision tasks. However, the success of the Transformer model has not yet been duly explained. Current explanation techniques, which dissect either the self-attention mechanism or gradient-based attribu…