2025
Incorporating Domain Knowledge into Materials Tokenization
ACL 2025long
While language models are increasingly utilized in materials science, typical models rely on frequency-centric tokenization methods originally developed for natural language processing. However, these methods frequently produce excessive fragmentation and semantic loss, failing to maintain the struc…