← Search

He Sun

28 accepted papers

2026

InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior

CVPR 2026

Video inverse problems such as inpainting, deblurring and super-resolution are fundamental to streaming, telepresence, and AR/VR, where high perceptual quality must coexist with tight latency constraints. Diffusion-based priors currently deliver state-of-the-art reconstructions, but existing approac

Cited by 0SourceScholar
2026

Let Language Constrain Geometry: Vision–Language Models as Semantic and Spatial Critics for 3D Generation

ICML 2026poster

Text-to-3D generation has advanced rapidly, yet state-of-the-art models, encompassing both optimization-based and feed-forward architectures, still face two fundamental limitations. First, they struggle with coarse semantic alignment, often failing to capture fine-grained prompt details. Second, the…

Cited by 0SourceScholar
2026

Masked Auto-Regressive Variational Acceleration: Fast Inference Makes Practical Reinforcement Learning

CVPR 2026

Masked auto-regressive diffusion models (MAR) benefit from the expressive modeling ability of diffusion models and the flexibility of masked auto-regressive ordering. However, vanilla MAR suffers from slow inference due to its hierarchical inference mechanism: an outer AR unmasking loop and an inner

Cited by 0SourcecodeScholar
2026

PETS: A Principled Framework Towards Optimal Trajectory Allocation for Efficient Test-Time Self-Consistency

ICML 2026poster

Test-time scaling can improve model performance by aggregating stochastic reasoning trajectories. However, achieving sample-efficient test-time self-consistency under a limited budget remains an open challenge. We introduce PETS (\textbf{P}rincipled and \textbf{E}fficient \textbf{T}est-Time \textbf{…

Cited by 0SourceScholar
2026

SFedPO: Streaming Federated Learning with a Prediction Oracle under Temporal Shifts

ICML 2026poster

Federated Learning (FL) enables decentralized clients to collaboratively train a global model without sharing raw data. However, most existing FL frameworks assume that clients train on static local datasets collected in advance or that the data follows a fixed underlying distribution, which limits …

Cited by 0SourceScholar
2025

FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation

NeurIPS 2025poster

Data assimilation (DA) integrates observations with a dynamical model to estimate states of PDE-governed systems. Model-driven methods (e.g., Kalman Filter, Particle Filter) presuppose full knowledge of the true dynamics, which is not always satisfied in practice, while purely data-driven solvers le…

Cited by 0SourcecodeScholar
2025

Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method

ICASSP 2025accepted

Diffusion models have demonstrated exceptional ability in modeling complex image distributions, making them versatile plug-and-play priors for solving imaging inverse problems. However, their reliance on large-scale clean datasets for training limits their applicability in scenarios where acquiring…

Cited by 0SourceScholar
2025

Uni-Instruct: One-step Diffusion Model through Unified Diffusion Divergence Instruction

NeurIPS 2025poster

In this paper, we unify more than 10 existing one-step diffusion distillation approaches, such as Diff-Instruct, DMD, SIM, SiD, $f$-distill, etc, inside a theory-driven framework which we name the \textbf{\emph{Uni-Instruct}}. Uni-Instruct is motivated by our proposed diffusion expansion theory of t…

Cited by 0SourceScholar
2024

An Expectation-Maximization Algorithm for Training Clean Diffusion Models from Corrupted Observations

NeurIPS 2024poster

Diffusion models excel in solving imaging inverse problems due to their ability to model complex image priors. However, their reliance on large, clean datasets for training limits their practical use where clean data is scarce. In this paper, we propose EMDiffusion, an expectation-maximization (EM)…

Cited by 10SourcePDFScholar
2023

Nearly-Optimal Hierarchical Clustering for Well-Clustered Graphs

ICML 2023poster

This paper presents two efficient hierarchical clustering (HC) algorithms with respect to Dasgupta's cost function. For any input graph $G$ with a clear cluster-structure, our designed algorithms run in nearly-linear time in the input size of $G$, and return an $O(1)$-approximate HC tree with respec…

2023

Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Movies

ICCV 2023poster

The dynamics of biomolecules are crucial for our understanding of their functioning in living systems. However, current 3D imaging techniques, such as cryogenic electron microscopy (cryo-EM), require freezing the sample, which limits the observation of their conformational changes in real time. The…

Cited by 5PDFScholar
2023

Reinforcement Learning with Stepwise Fairness Constraints

AISTATS 2023poster

AI methods are used in societally important settings, ranging from credit to employment to housing, and it is crucial to provide fairness in regard to automated decision making. Moreover, many settings are dynamic, with populations responding to sequential decision policies. We introduce the study o…

Cited by 15SourcePDFScholar
2021

Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging

AAAI 2021technical

Computational image reconstruction algorithms generally produce a single image without any measure of uncertainty or confidence. Regularized Maximum Likelihood (RML) and feed-forward deep learning approaches for inverse problems typically focus on recovering a point estimate. This is a serious limit…

2020

Hermitian matrices for clustering directed graphs: insights and applications

AISTATS 2020poster

Graph clustering is a basic technique in machine learning, and has widespread applications in different domains. While spectral techniques have been successfully applied for clustering undirected graphs, the performance of spectral clustering algorithms for directed graphs (digraphs) is not in gener…

Cited by 59SourcePDFScholar