← Search

Juhao Liang

4 accepted papers

2025

Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts

ICLR 2025poster

Adapting medical Large Language Models to local languages can reduce barriers to accessing healthcare services, but data scarcity remains a significant challenge, particularly for low-resource languages. To address this, we first construct a high-quality medical dataset and conduct analysis to ensu…

2025

Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion

ACL 2025long

This paper addresses the critical need for democratizing large language models (LLM) in the Arab world, a region that has seen slower progress in developing models comparable to state-of-the-art offerings like GPT-4 or GPT-3.5, due to a predominant focus on mainstream languages (e.g., English and Ch…

2025

Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planning

NAACL 2025long

Teaching large language models (LLMs) to use tools for solving complex problems can grant them human-like reasoning abilities. ReAct and its variants are popular frameworks for tool use in both single-agent and multi-agent systems. To address issues like error propagation and limited exploration in…

2024

Alignment at Pre-training! Towards Native Alignment for Arabic LLMs

NeurIPS 2024poster

The alignment of large language models (LLMs) is critical for developing effective and safe language models. Traditional approaches focus on aligning models during the instruction tuning or reinforcement learning stages, referred to in this paper as `\textit{post alignment}'. We argue that alignment…