← Search

Chaoyi Ruan

2 accepted papers

2026

Revisiting Parameter Server in LLM Post-Training

ICLR 2026poster

Modern data parallel (DP) training favors collective communication over parameter servers (PS) for its simplicity and efficiency under balanced workloads. However, the balanced workload assumption no longer holds in large language model (LLM) post-training due to the large variance in sequence lengt…

Cited by 0SourcecodeScholar
2025

PMPO: Probabilistic Metric Prompt Optimization for Small and Large Language Models

EMNLP 2025

Prompt optimization is a practical and widely applicable alternative to fine tuning for improving large language model performance. Yet many existing methods evaluate candidate prompts by sampling full outputs, often coupled with self critique or human annotated preferences, which limits scalability

Cited by 0SourcePDFScholar