← Search

Weiqiang Bai

2 accepted papers

2025

Revisiting Convolution Architecture in the Realm of DNA Foundation Models

ICLR 2025poster

In recent years, A variety of methods based on Transformer and state space model (SSM) architectures have been proposed, advancing foundational DNA language models. However, there is a lack of comparison between these recent approaches and the classical architecture—convolutional networks (CNNs)—on…

Cited by 0SourcePDFScholar
2024

Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNA

NeurIPS 2024poster

Foundation models have made significant strides in understanding the genomic language of DNA sequences. However, previous models typically adopt the tokenization methods designed for natural language, which are unsuitable for DNA sequences due to their unique characteristics. In addition, the optima…