Fast Variational Estimation of Mutual Information for Implicit and Explicit Likelihood Models
Computing mutual information (MI) of random variables lacks a closed-form in nontrivial models. Variational MI approximations are widely used as flexible estimators for this purpose, but computing them typically requires solving a costly nonconvex optimization. We prove that a widely used class of v…