Hengzhi He

``Noisier'’ Noise Contrastive Estimation is (Almost) Maximum Likelihood

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which significantly limits the applicability of NCE on modern hig…