← Search

Chengpeng Li

6 accepted papers

2026

CALM Before the STORM: Unlocking Native Reasoning for Optimization Modeling

ICML 2026poster

Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for earlier instruction-tuned models, often fail to exploit the advanc…

Cited by 0SourceScholar
2025

START: Self-taught Reasoner with Tools

EMNLP 2025

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations. Integrating computational tools with LRMs remains challenging, particularly in activating and enhancing

2025

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models

ICLR 2025spotlight

One core capability of large language models~(LLMs) is to follow natural language instructions. However, the issue of automatically constructing high-quality training data to enhance the complex instruction-following abilities of LLMs without manual annotation remains unresolved. In this paper, we i…

2025

Teaching Language Models to Reason with Tools

NeurIPS 2025poster

Large reasoning models (LRMs) like OpenAI-o1 have shown impressive capabilities in natural language reasoning. However, these models frequently demonstrate inefficiencies or inaccuracies when tackling complex mathematical operations. While integrating computational tools such as Code Interpreters (C…

Cited by 0SourcecodeScholar
2024

How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

ACL 2024long

Large language models (LLMs) with enormous pre-training tokens and parameters emerge diverse abilities, including math reasoning, codegeneration, and instruction following. These abilities are further enhanced by supervised fine-tuning (SFT). While the open-source community has explored ad-hoc SFT f…

2024

MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning

ACL 2024long

In math reasoning with large language models (LLMs), fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective, profoundly narrowing the gap between open-sourced LLMs and cutting-edge proprietary LLMs. In this paper, we conduct an investigation fo…