2026
TINYDROP: TINY MODEL GUIDED TOKEN DROPPING FOR VISION TRANSFORMERS
ICASSP 2026poster
Vision Transformers (ViTs) achieve strong performance in image classification but incur high computational costs from processing all image tokens. To reduce inference costs in large ViTs without compromising accuracy, we propose TinyDrop, a training-free token dropping framework guided by a lightwei…