2026
Enhancing Layer Attention Efficiency through Pruning Redundant Retrievals
ICASSP 2026poster
Growing evidence suggests that layer attention mechanisms, which enhance interaction among layers in deep neural networks, have significantly advanced network architectures. However, existing layer attention methods suffer from redundancy, as attention weights learned by adjacent layers often become…