Suho Kim

MELT: Materials-aware Continued Pre-training for Language Model Adaptation to Materials Science

We introduce a novel continued pre-training method, MELT (MatEriaLs-aware continued pre-Training), specifically designed to efficiently adapt the pre-trained language models (PLMs) for materials science. Unlike previous adaptation strategies that solely focus on constructing domain-specific corpus,…