2026
Predicting evolutionary rate as a pretraining task improves genome language model representations
ICML 2026poster
Genome language models (gLM) have the potential to further understanding of regulatory genomics without requiring labeled data. Most gLMs are pretrained using sequence reconstruction tasks inspired by natural language processing, but recent studies have shown that these gLMs often fail to capture bi…