2022
Training Discrete Deep Generative Models via Gapped Straight-Through Estimator
ICML 2022spotlight
While deep generative models have succeeded in image processing, natural language processing, and reinforcement learning, training that involves discrete random variables remains challenging due to the high variance of its gradient estimation process. Monte Carlo is a common solution used in most va…