← Search

Hongrui Jia

4 accepted papers

2026

From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Models

ICML 2026poster

As Large Multimodal Models (LMMs) scale up and reinforcement learning (RL) methods mature, LMMs have made notable progress in complex reasoning and decision making. Yet training still relies on static data and fixed recipes, making it difficult to diagnose capability blind spots or provide dynamic, …

Cited by 0SourceScholar
2026

OSWorld-MCP: Benchmarking MCP Tool Invocation In Computer-Use Agents

ICLR 2026poster

With advances in decision-making and reasoning capabilities, multimodal agents show strong potential in computer application scenarios. Past evaluations have mainly assessed GUI interaction skills, while tool invocation abilities, such as those enabled by the Model Context Protocol (MCP), have been…

Cited by 0SourcecodeScholar
2026

What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?

ICML 2026spotlight

Large language models are increasingly evaluated as interactive agents, yet standard agent benchmarks conflate two qualitatively distinct sources of success: semantic tool-use and interface-specific interaction pattern memorization. Because both mechanisms can yield identical task success on the ori…

Cited by 0SourceScholar
2025

SymDPO: Boosting In-Context Learning of Large Multimodal Models with Symbol Demonstration Direct Preference Optimization

CVPR 2025poster

As language models continue to scale, Large Language Models (LLMs) have exhibited emerging capabilities in In-Context Learning (ICL), enabling them to solve language tasks by prefixing a few in-context demonstrations (ICDs) as context. Inspired by these advancements, researchers have extended these…