Anton Smirnov

Scaling Transformers for Low-Bitrate High-Quality Speech Coding

The tokenization of audio with neural audio codec models is a vital part of modern AI pipelines for the generation or understanding of speech, alone or in a multimodal context. Traditionally such tokenization models have concentrated on low parameter-count architectures using only components with st…