← Search

Zhicai Ou

4 accepted papers

2023

ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector

CVPR 2023poster

Despite the prominent success of general object detection, the performance and efficiency of Small Object Detection (SOD) are still unsatisfactory. Unlike existing works that struggle to balance the trade-off between inference speed and SOD performance, in this paper, we propose a novel Scale-aware…

Cited by 39SourcePDFScholar
2022

Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation

NeurIPS 2022accept

Knowledge distillation (KD) can effectively compress neural networks by training a smaller network (student) to simulate the behavior of a larger one (teacher). A counter-intuitive observation is that a more expansive teacher does not make a better student, but the reasons for this phenomenon remain…

Cited by 33SourcePDFScholar