Sayed Mohammad Vakilzadeh Hatefi

AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers

Large Language Models are prone to biased predictions and hallucinations, underlining the paramount importance of understanding their model-internal reasoning process. However, achieving faithful attributions for the entirety of a black-box transformer model and maintaining computational efficiency…