2026
Scaling Transformers for End-to-End Discrete Audio Tokenization
ICML 2026poster
Discrete audio tokenizers are fundamental to empowering large language models with native audio processing and generation capabilities. Despite recent progress, existing approaches often rely on pretrained encoders, semantic distillation, or heterogeneous CNN-based architectures. These designs intro…