Ayush Shrivastava*

Self-Supervised Any-Point Tracking by Contrastive Random Walks

"We present a simple, self-supervised approach to the Tracking Any Point (TAP) problem. We train a global matching transformer to find cycle consistent tracks through video via contrastive random walks, using the transformer’s attention-based global matching to define the transition matrices for a r…