← Search

Peng Xia

19 accepted papers

2026

Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning

ICML 2026oral

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to overcome this constraint by allowing models to act as their…

Cited by 27SourceScholar
2026

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

ICLR 2026poster

Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent efforts introduce multi-agent collaboration frameworks insp…

Cited by 0SourceScholar
2026

Multiplayer Nash Preference Optimization

ICLR 2026oral

Reinforcement learning from human feedback (RLHF) has emerged as the standard paradigm for aligning large language models (LLMs) with human preferences. However, reward-based methods built on the Bradley–Terry assumption struggle to capture the non-transitive and heterogeneous nature of real-world p…

Cited by 0SourcecodeScholar
2026

Paper2Figure: A Multi-Agent Collaborative System for Figure Generation Towards Academic Research Paper

CVPR 2026

Automatically generating clear and accurate figures for research papers remains challenging, as it requires semantic understanding, precise structure, and visual aesthetics. Existing approaches struggle to balance fidelity and quality: large language model (LLM) code-based methods (e.g., SVG, Mermai

Cited by 0SourceScholar
2026

Proteo-R1: Thinking Foundation Models for De Novo Protein Binder Design

ICML 2026poster

Recent advances in generative diffusion and flow-matching models have revolutionized molecular design, enabling the creation of novel proteins, small molecules, and RNA sequences with unprecedented fidelity. Yet, these models remain intuitive rather than intelligent—they generate without reasoning. …

Cited by 0SourceScholar
2026

SimpleMem: Efficient Lifelong Memory for LLM Agents

ICML 2026poster

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to substantial redundancy, or rely on iterative reasoning to filter nois…

Cited by 0SourceScholar
2026

WebWatcher: Breaking New Frontiers of Vision-Language Deep Research Agent

ICLR 2026poster

Web agents such as deep research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains largely text-centric, overlooking visual information in the real world. This makes multimodal deep research highly cha…

Cited by 0SourceScholar
2025

Anyprefer: An Agentic Framework for Preference Data Synthesis

ICLR 2025poster

High-quality preference data is essential for aligning foundation models with human values through preference learning. However, manual annotation of such data is often time-consuming and costly. Recent methods often adopt a self-rewarding approach, where the target model generates and annotates its…

Cited by 0SourcePDFScholar
2025

HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding

COLING 2025main

Object categories are typically organized into a multi-granularity taxonomic hierarchy. When classifying categories at different hierarchy levels, traditional uni-modal approaches focus primarily on image features, revealing limitations in complex scenarios. Recent studies integrating Vision-Languag…

2025

MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference

NeurIPS 2025spotlight

Recent advancements in video generation have significantly improved the ability to synthesize videos from text instructions. However, existing models still struggle with key challenges such as instruction misalignment, content hallucination, safety concerns, and generation bias. To address these lim…

Cited by 0SourceScholar
2025

MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models

ICLR 2025oral

Interleaved multimodal comprehension and generation, enabling models to produce and interpret both images and text in arbitrary sequences, have become a pivotal area in multimodal learning. Despite significant advancements, the evaluation of this capability remains insufficient. Existing benchmarks…

2025

MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models

ICLR 2025poster

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities for interactive diagnostic tools. However, these models oft…

2025

MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization

ICML 2025poster

The advancement of Large Vision-Language Models (LVLMs) has propelled their application in the medical field. However, Medical LVLMs (Med-LVLMs) encounter factuality challenges due to modality misalignment, where the models prioritize textual knowledge over visual input, leading to hallucinations th…

2025

Neighbor Does Matter: Density-Aware Contrastive Learning for Medical Semi-supervised Segmentation

AAAI 2025technical

In medical image analysis, multi-organ semi-supervised segmentation faces challenges such as insufficient labels and low contrast in soft tissues. To address these issues, existing studies typically employ semi-supervised segmentation techniques using pseudo-labeling and consistency regularization.…

Cited by 2SourcePDFScholar
2025

Towards Realistic Semi-supervised Medical Image Classification

AAAI 2025technical

Existing semi-supervised learning (SSL) approaches follow the idealized closed-world assumption, neglecting the challenges present in realistic medical scenarios, such as open-set distribution and imbalanced class distribution. Although some methods in natural domains attempt to address the open-set…

Cited by 0SourcePDFScholar
2024

CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models

NeurIPS 2024poster

Artificial intelligence has significantly impacted medical applications, particularly with the advent of Medical Large Vision Language Models (Med-LVLMs), sparking optimism for the future of automated and personalized healthcare. However, the trustworthiness of Med-LVLMs remains unverified, posing s…

2024

OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding

ECCV 2024poster

"Surgical scene perception via videos is critical for advancing robotic surgery, telesurgery, and AI-assisted surgery, particularly in ophthalmology. However, the scarcity of diverse and richly annotated video datasets has hindered the development of intelligent systems for surgical workflow analysi…

2024

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

EMNLP 2024main

The recent emergence of Medical Large Vision Language Models (Med-LVLMs) has enhanced medical diagnosis. However, current Med-LVLMs frequently encounter factual issues, often generating responses that do not align with established medical facts. Retrieval-Augmented Generation (RAG), which utilizes e…

2023

NurViD: A Large Expert-Level Video Database for Nursing Procedure Activity Understanding

NeurIPS 2023poster

The application of deep learning to nursing procedure activity understanding has the potential to greatly enhance the quality and safety of nurse-patient interactions. By utilizing the technique, we can facilitate training and education, improve quality control, and enable operational compliance mon…