← Search

Grant M. Rotskoff

7 accepted papers

2026

DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Models

ICLR 2026poster

We study inference-time scaling for diffusion models, where the goal is to adapt a pre-trained model to new target distributions without retraining. Existing guidance-based methods are simple but introduce bias, while particle-based corrections suffer from weight degeneracy and high computational co…

Cited by 0SourcecodeScholar
2025

Aligning Transformers with Continuous Feedback via Energy Rank Alignment

NeurIPS 2025poster

Searching through chemical space is an exceptionally challenging problem because the number of possible molecules grows combinatorially with the number of atoms. Large, autoregressive models trained on databases of chemical compounds have yielded powerful generators, but we still lack robust strateg…

Cited by 0SourceScholar
2025

Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms

NeurIPS 2025poster

Discrete diffusion models have emerged as a powerful generative modeling framework for discrete data with successful applications spanning from text generation to image synthesis. However, their deployment faces challenges due to the high dimensionality of the state space, necessitating the developm…

Cited by 0SourcecodeScholar
2025

Features are fate: a theory of transfer learning in high-dimensional regression

ICML 2025poster

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been successfully employed for these purposes when the target task c…

Cited by 1SourcePDFScholar
2025

How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework

ICLR 2025poster

Discrete diffusion models have gained increasing attention for their ability to model complex distributions with tractable sampling and inference. However, the error analysis for discrete diffusion models remains less well-understood. In this work, we propose a comprehensive framework for the error…

Cited by 10SourcePDFScholar
2024

Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity

NeurIPS 2024spotlight

Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and \emph{evaluate}, reducing the inference cost for diffusion models remains a major goal. Inspired by the recent empirical success in accelerating diffusion…

Cited by 15SourcePDFScholar