2024
On the connection between Noise-Contrastive Estimation and Contrastive Divergence
AISTATS 2024poster
Noise-contrastive estimation (NCE) is a popular method for estimating unnormalised probabilistic models, such as energy-based models, which are effective for modelling complex data distributions. Unlike classical maximum likelihood (ML) estimation that relies on importance sampling (resulting in ML-…