Daniel Shalam*

Unsupervised Representation Learning by Balanced Self Attention Matching

"Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to instabilities that can lead to feature collapse. Different technique…