Chengzhi Zhong

What Language Do Non-English-Centric Large Language Models Think in?

In this study, we investigate whether non-English-centric large language models, ‘think’ in their specialized language. Specifically, we analyze how intermediate layer representations, when projected into the vocabulary space, favor certain languages during generation—termed as latent languages. We…