← Search

Siwei Han

13 accepted papers

2026

Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning

ICML 2026poster

Recent advances in large language model (LLM) have empowered autonomous agents to perform complex tasks that require multi-turn interactions with external tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments. In this paper, we propo…

Cited by 0SourceScholar
2026

Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning

ICML 2026oral

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to overcome this constraint by allowing models to act as their…

Cited by 27SourceScholar
2026

From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization

ICLR 2026poster

While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations remains limited. Most existing approaches focus primarily on textual reasoning, ov…

Cited by 0SourceScholar
2026

GRAPE: Generalizing Robot Policy Via Preference Alignment

ICRA 2026poster

Despite the recent advancements of vision-language-action (VLA) models on a variety of robotics tasks, they suffer from critical issues such as poor generalizability to unseen tasks, due to their reliance on behavior cloning exclusively from successful rollouts. Furthermore, they are typically fine-…

2026

Paper2Figure: A Multi-Agent Collaborative System for Figure Generation Towards Academic Research Paper

CVPR 2026

Automatically generating clear and accurate figures for research papers remains challenging, as it requires semantic understanding, precise structure, and visual aesthetics. Existing approaches struggle to balance fidelity and quality: large language model (LLM) code-based methods (e.g., SVG, Mermai

Cited by 0SourceScholar
2026

SimpleMem: Efficient Lifelong Memory for LLM Agents

ICML 2026poster

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to substantial redundancy, or rely on iterative reasoning to filter nois…

Cited by 0SourceScholar
2026

Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document Collections

ICML 2026oral

Multimodal agents offer a compelling path to automating complex document-intensive workflows, yet a critical question remains: do these architectures demonstrate genuine strategic reasoning, or simply conduct stochastic trial-and-error search? To address this, we introduce Agentic Document VQA, a be…

Cited by 0SourceScholar
2025

GLIMPSE: Do Large Vision-Language Models Truly Think With Videos or Just Glimpse at Them?

EMNLP 2025

Existing video benchmarks often resemble image-based benchmarks, with question types like “What actions does the person perform throughout the video?” or “What color is the woman’s dress in the video?” For these, models can often answer by scanning just a few key frames, without deep temporal reason

2025

MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?

NeurIPS 2025poster

While text-to-image models like GPT-4o-Image and FLUX are rapidly proliferating, they often encounter challenges such as hallucination, bias, and the production of unsafe, low-quality output. To effectively address these issues, it is crucial to align these models with desired behaviors based on fee…

Cited by 0SourcecodeScholar
2025

MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference

NeurIPS 2025spotlight

Recent advancements in video generation have significantly improved the ability to synthesize videos from text instructions. However, existing models still struggle with key challenges such as instruction misalignment, content hallucination, safety concerns, and generation bias. To address these lim…

Cited by 0SourceScholar
2025

MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models

ICLR 2025oral

Interleaved multimodal comprehension and generation, enabling models to produce and interpret both images and text in arbitrary sequences, have become a pivotal area in multimodal learning. Despite significant advancements, the evaluation of this capability remains insufficient. Existing benchmarks…

2025

ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding

NeurIPS 2025poster

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm without dynamic feedback, limiting the model’s capacity to se…

Cited by 0SourceScholar
2024

Generating Chain-of-Thoughts with a Pairwise-Comparison Approach to Searching for the Most Promising Intermediate Thought

ICML 2024poster

To improve the ability of the large language model (LLMs) to tackle complex reasoning problems, chain-of-thoughts (CoT) methods were proposed to guide LLMs to reason step-by-step, enabling problem solving from simple to complex. State-of-the-art methods for generating such a chain involve interactiv…

Cited by 5SourcePDFScholar