2024
Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals
RSS 2024poster
This work introduces the Multimodal Diffusion Transformer (MDT), a novel diffusion policy framework, that excels at learning versatile behavior from multimodal goal specifications with few language annotations. MDT leverages a diffusion based multimodal transformer backbone and two self-supervised a…