← Search

Peng Mi

4 accepted papers

2022

Active Teacher for Semi-Supervised Object Detection

CVPR 2022poster

In this paper, we study teacher-student learning from the perspective of data initialization and propose a novel algorithm called Active Teacher for semi-supervised object detection (SSOD). Active Teacher extends the teacher-student framework to an iterative version, where the label set is partially…

Cited by 93PDFcodeScholar
2022

Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

EMNLP 2022finding

Fine-tuning large pretrained language models on a limited training corpus usually suffers from poor generalization. Prior works show that the recently-proposed sharpness-aware minimization (SAM) optimization method can improve the model generalization. However, SAM adds a perturbation to each model…

2022

Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach

NeurIPS 2022accept

Deep neural networks often suffer from poor generalization caused by complex and non-convex loss landscapes. One of the popular solutions is Sharpness-Aware Minimization (SAM), which smooths the loss landscape via minimizing the maximized change of training loss when adding a perturbation to the wei…