Elaa Bouazza

Particles Don’t Care About Z: Towards Scaling Entropy Estimation of Unnormalized Densities

Computing the differential entropy of distributions known only up to a normalization constant is a long-standing challenge with broad theoretical and practical significance. While variational inference is the most scalable approach for density approximation _from samples_, its potential in settings …