2021
Influence Patterns for Explaining Information Flow in BERT
NeurIPS 2021poster
While attention is all you need may be proving true, we do not know why: attention-based transformer models such as BERT are superior but how information flows from input tokens to output predictions are unclear. We introduce influence patterns, abstractions of sets of paths through a transformer…