2022
GLAMD: Global and Local Attention Mask Distillation for Object Detectors
ECCV 2022poster
"Knowledge distillation (KD) is a well-known model compression strategy to improve models’ performance with fewer parameters. However, recent KD approaches for object detection have faced two limitations. First, they distill nearby foreground regions, ignoring potentially useful background informati…