Tan M. Nguyen

A Probabilistic Framework for Pruning Transformers Via a Finite Admixture of Keys

Pairwise dot product-based self-attention is key to the success of transformers which achieve state-of-the-art performance across a variety of applications in language and vision, but are costly to compute. It has been shown that most attention scores and keys in transformers are redundant and can b…