← Search

Alexander Tolmachev

4 accepted papers

2026

GAS: Improving Discretization of Diffusion ODEs via Generalized Adversarial Solver

ICLR 2026poster

While diffusion models achieve state-of-the-art generation quality, they still suffer from computationally expensive sampling. Recent works address this issue with gradient-based optimization methods that distill a few-step ODE diffusion solver from the full sampling process, reducing the number of…

Cited by 0SourcecodeScholar
2025

Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax

ICLR 2025poster

Deep InfoMax (DIM) is a well-established method for self-supervised representation learning (SSRL) based on maximization of the mutual information between the input and the output of a deep neural network encoder. Despite the DIM and contrastive SSRL in general being well-explored, the task of learn…

Cited by 0SourcePDFScholar
2024

Information Bottleneck Analysis of Deep Neural Networks via Lossy Compression

ICLR 2024poster

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between the hidden layer output and the DNN input/target. According…

Cited by 7SourcePDFScholar
2024

Mutual Information Estimation via Normalizing Flows

NeurIPS 2024poster

We propose a novel approach to the problem of mutual information (MI) estimation via introducing a family of estimators based on normalizing flows. The estimator maps original data to the target distribution, for which MI is easier to estimate. We additionally explore the target distributions with k…

Cited by 8SourcePDFScholar