2024
A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation
NeurIPS 2024poster
Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training a separate model for each task which is expensive. Here, we…