Zheng Chuanyang

SAViT: Structure-Aware Vision Transformer Pruning via Collaborative Optimization

Vision Transformers (ViTs) yield impressive performance across various vision tasks. However, heavy computation and memory footprint make them inaccessible for edge devices. Previous works apply importance criteria determined independently by each individual component to prune ViTs. Considering that…