Mangsuo Zhao

Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer

Despite the significant progress in controllable music generation and editing, challenges remain in the quality and length of generated music due to the use of Mel-spectrogram representations and UNet-based model structures. To address these limitations, we propose a novel approach using a Diffusion…