2025
MuPT: A Generative Symbolic Music Pretrained Transformer
ICLR 2025poster
In this paper, we explore the application of Large Language Models (LLMs) to the pre-training of music. While the prevalent use of MIDI in music modeling is well-established, our findings suggest that LLMs are inherently more compatible with ABC Notation, which aligns more closely with their design…