2024
SNP: Structured Neuron-level Pruning to Preserve Attention Scores
ECCV 2024poster
"Multi-head self-attention (MSA) is a key component of Vision Transformers (ViTs), which have achieved great success in various vision tasks. However, their high computational cost and memory footprint hinder their deployment on resource-constrained devices. Conventional pruning approaches can only…