← Search

Yuewei Yang

2 accepted papers

2022

Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

NeurIPS 2022accept

Successful applications of InfoNCE (Information Noise-Contrastive Estimation) and its variants have popularized the use of contrastive variational mutual information (MI) estimators in machine learning . While featuring superior stability, these estimators crucially depend on costly large-batch trai…