Yijia Dai

Pre-trained Large Language Models Learn to Predict Hidden Markov Models In-context

Hidden Markov Models (HMMs) are fundamental tools for modeling sequential data with latent states that follow Markovian dynamics. However, they present significant challenges in model fitting and computational efficiency on real-world datasets. In this work, we demonstrate that pre-trained large l…