Yifan Pu*

Efficient Diffusion Transformer with Step-wise Dynamic Attention Mediators

"This paper identifies significant redundancy in the query-key interactions within self-attention mechanisms of diffusion transformer models, particularly during the early stages of denoising diffusion steps. In response to this observation, we present a novel diffusion transformer framework incorpo…