2024
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
ECCV 2024poster
"Transformer-based architectures have become the de-facto standard models for diverse vision tasks owing to their superior performance. As the size of these transformer-based models continues to scale up, model distillation becomes extremely important in real-world deployments, particularly on devic…