2026
Dynamic Chunking for End-to-End Hierarchical Sequence Modeling
ICLR 2026poster
Major progress on language models (LMs) in recent years has largely resulted from moving away from specialized models designed for specific tasks, to general models based on powerful architectures (e.g. the Transformer) that learn everything from raw data. Despite this trend, pre-processing steps su…