2026
DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs
ICML 2026poster
The scaling of large language models (LLMs) is currently bottlenecked by the rigidity of distributed programming. While high-performance libraries like CuBLAS and NCCL provide optimized primitives, they lack the flexibility required for rapidly evolving model architectures. Conversely, existing tens…