← Search

Wenhan Han

3 accepted papers

2026

Translation Heads: Unveiling Attention's Role in LLM Multilingual Translation

ICLR 2026poster

Recently, large language models (LLMs) have made remarkable progress, with multilingual capability emerging as a core foundational strengths. However, the internal mechanisms by which these models perform translation remain incompletely understood. In this paper, we elucidate the relationship betwee…

Cited by 0SourceScholar
2025

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining

NeurIPS 2025poster

Data quality is a critical driver of large language model performance, yet existing model-based selection methods focus almost exclusively on English, neglecting other languages that are essential in the training mix for multilingual LLMs. We introduce MuRating, a scalable framework that transfers h…

Cited by 0SourceScholar
2024

MedINST: Meta Dataset of Biomedical Instructions

EMNLP 2024finding

The integration of large language model (LLM) techniques in the field of medical analysis has brought about significant advancements, yet the scarcity of large, diverse, and well-annotated datasets remains a major challenge. Medical data and tasks, which vary in format, size, and other parameters, r…