← Search

Yumou Liu

2 accepted papers

2026

Lost in Tokenization: Context as the Key to Unlocking Biomolecular Understanding in Scientific LLMs

ICLR 2026poster

Scientific Large Language Models (Sci-LLMs) have emerged as a promising frontier for accelerating biological discovery. However, these models face a fundamental challenge when processing raw biomolecular sequences: the tokenization dilemma. Whether treating sequences as a specialized language, riski…

Cited by 0SourcecodeScholar
2025

Periodical Moving Average Accelerates Gradient Accumulation for Post-Training

UAI 2025

High gradient variance presents a significant obstacle to efficient post-training of large language models (LLMs) on memory-constrained devices. Existing practical strategies-such as reducing batch sizes or adopting gradient accumulation (GA)-suffer from an inherent trade-off: smaller batches exacer

Cited by 0SourcePDFScholar