2026
OmniScale: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
AAAI 2026technical
Recent advances in large language models (LLMs) have driven impressive progress in omni-modal understanding and generation. However, training omni-modal LLMs remains a significant challenge due to the heterogeneous model architectures required to process diverse modalities, necessitating sophisticat