Unsupervised Learning of Object Landmarks via Self-Training Correspondence
Dimitrios Mallis, Enrique Sanchez, Matthew Bell, Georgios Tzimiropoulos
Abstract
This paper addresses the problem of unsupervised discovery of object landmarks. We take a different path compared to that of existing works, based on 2 novel perspectives: (1) Self-training: starting from generic keypoints, we propose a self-training approach where the goal is to learn a detector that improves itself becoming more and more tuned to object landmarks. (2) Correspondence: we identify correspondence as a key objective for unsupervised landmark discovery and propose an optimization scheme which alternates between recovering object landmark correspondence across different images via clustering and learning an object landmark descriptor without labels. Compared to previous works, our approach can learn landmarks that are more flexible in terms of capturing large changes in viewpoint. We show the favourable properties of our method on a variety of difficult datasets including LS3D, BBCPose and Human3.6M. Code is available at https://github.com/malldimi1/UnsupervisedLandmarks
BibTeX
@inproceedings{NEURIPS2020_32508f53,
author = {Mallis, Dimitrios and Sanchez, Enrique and Bell, Matthew and Tzimiropoulos, Georgios},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {4709--4720},
publisher = {Curran Associates, Inc.},
title = {Unsupervised Learning of Object Landmarks via Self-Training Correspondence},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/32508f53f24c46f685870a075eaaa29c-Paper.pdf},
volume = {33},
year = {2020}
}