← Search

Hongzhou Zhu

6 accepted papers

2026

Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Video Generation

ICML 2026poster

To achieve real-time video generation, current approaches distill pretrained bidirectional video diffusion models into few-step autoregressive (AR) models. This process involves an *architectural gap*, as it converts full attention into causal attention. In this paper, we demonstrate that existing m…

Cited by 0SourceScholar
2026

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

ICLR 2026poster

In Diffusion Transformer (DiT) models, particularly for video generation, attention latency is a major bottleneck due to the long sequence length and the quadratic complexity. Interestingly, we find that attention weights can be decoupled into two matrices: a small fraction of large weights with hig…

Cited by 44SourcecodeScholar
2026

UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers

ICLR 2026poster

Despite advances, video diffusion transformers still struggle to generalize beyond their training length, a challenge we term video length extrapolation. We identify two failure modes: model-specific periodic content repetition and a universal quality degradation. Prior works attempt to solve repeti…

Cited by 0SourcecodeScholar
2025

Automatic Numbering and Pathological Recognition of Pediatric Teeth Using CNN and Attention Mechanisms

ICASSP 2025accepted

Preliminary progress has been made in using deep learning networks for tooth segmentation and numbering, as well as pathological identification in dental panoramic images. However, The publicly available datasets specifically for children’s teeth are very scarce. To address this issue, this paper pr…

Cited by 0SourceScholar
2025

RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers

ICML 2025poster

Recent advancements in video generation have enabled models to synthesize high-quality, minute-long videos. However, generating even longer videos with temporal coherence remains a major challenge and existing length extrapolation methods lead to temporal repetition or motion deceleration. In this w…

Cited by 0SourcePDFScholar
2024

Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model

NeurIPS 2024poster

Diffusion models have obtained substantial progress in image-to-video generation. However, in this paper, we find that these models tend to generate videos with less motion than expected. We attribute this to the issue called conditional image leakage, where the image-to-video diffusion models (I2V-…