2024
EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence
ICML 2024poster
A key challenge in contrastive learning is to generate negative samples from a large sample set to contrast with positive samples, for learning better encoding of the data. These negative samples often follow a softmax distribution which are dynamically updated during the training process. However,…