Zhi-Hong Deng*

Token Compensator: Altering Inference Cost of Vision Transformer without Re-Tuning

"Token compression expedites the training and inference of Vision Transformers (ViTs) by reducing the number of the redundant tokens, , pruning inattentive tokens or merging similar tokens. However, when applied to downstream tasks, these approaches suffer from significant performance drop when the…