Mateusz Ochal

Prediction-Guided Distillation for Dense Object Detection

"Real-world object detection models should be cheap and accurate. Knowledge distillation (KD) can boost the accuracy of a small, light detection model by leveraging useful information from a larger teacher model. However, a key challenge is identifying the most informative features produced by the t…