← Search

Shikang Zheng

7 accepted papers

2026

A Flat Vocabulary or a Rich Hierarchy? Re-introducing Intrinsic Structure Transforms the Autoregressive Image Generation

ICML 2026poster

Autoregressive (AR) models have shown great promise in image generation, yet they face a fundamental inefficiency stemming from their core component: a vast, unstructured vocabulary of visual tokens. By treating tokens as a flat set, standard models overlook the manifold structure where geometric pr…

Cited by 0SourceScholar
2026

Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models

CVPR 2026

Diffusion Transformers (DiTs) have achieved state-of-the-art image and video generation performance, but sampling remains expensive due to repeated transformer forward passes over many timesteps. Feature caching offers a training-free way to accelerate inference by reusing or forecasting hidden repr

Cited by 0SourcecodeScholar
2026

Forecast Then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers

AAAI 2026technical

Diffusion Transformers (DiTs) have demonstrated exceptional performance in high-fidelity image and video generation. To reduce their substantial computational costs, feature caching techniques have been proposed to accelerate inference by reusing hidden representations from previous timesteps. Howev

Cited by 0SourcePDFScholar
2026

Forecast the Principal, Stabilize the Residual: Subspace-Aware Feature Caching for Diffusion Transformers

CVPR 2026

Diffusion Transformer (DiT) models have achieved unprecedented quality in image and video generation, yet their iterative sampling process remains computationally prohibitive. To accelerate inference, feature caching methods have emerged by reusing or forecasting intermediate representations across

Cited by 0SourcecodeScholar
2026

From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolution

CVPR 2026

Diffusion Transformers achieve impressive generative quality but remain computationally expensive due to iterative sampling. Recently, dynamic resolution sampling has emerged as a promising acceleration technique by reducing the resolution of early sampling steps. However, existing methods rely on h

Cited by 0SourcecodeScholar
2026

HiCache: A Plug-in Scaled-Hermite Upgrade for Taylor-Style Cache-then-Forecast Diffusion Acceleration

ICLR 2026poster

Diffusion models have achieved remarkable success in content generation but suffer from prohibitive computational costs due to iterative sampling. While recent feature caching methods tend to accelerate inference through temporal extrapolation, these methods still suffer from severe quality loss due…

Cited by 0SourcecodeScholar
2026

Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers

ICLR 2026oral

Diffusion Transformers (DiTs) offer state-of-the-art fidelity in image and video synthesis, but their iterative sampling process remains a major bottleneck due to the high cost of transformer forward passes at each timestep. To mitigate this, feature caching has emerged as a training-free accelerati…

Cited by 0SourceScholar