← Search

Shihao Cai

3 accepted papers

2026

Scaling Agents via Continual Pre-training

ICLR 2026poster

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models consistently underperform in agentic tasks, particularly in open-sourc…

Cited by 0SourcecodeScholar
2025

K-order Ranking Preference Optimization for Large Language Models

ACL 2025finding

To adapt large language models (LLMs) to ranking tasks, existing list-wise methods, represented by list-wise Direct Preference Optimization (DPO), focus on optimizing partial-order or full-order list ranking consistency for LLMs to enhance their ranking abilities.However, we argue that optimizing to…

2024

GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation

EMNLP 2024main

Large language models have seen widespread adoption in math problem-solving, yet for geometry problems, which often necessitate visual aids even for humans, the most advanced multi-modal models still struggle to effectively utilize image information. High-quality data is crucial for enhancing the ge…