← Search

Zichen Wen

18 accepted papers

2026

D²Pruner: Debiased Importance and Structural Diversity for MLLM Token Pruning

AAAI 2026technical

Processing long visual token sequences poses a significant computational burden on Multimodal Large Language Models (MLLMs). While token pruning offers a path to acceleration, we find that current methods, while adequate for general understanding, catastrophically fail on fine-grained localization t

Cited by 0SourcePDFScholar
2026

OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning

CVPR 2026

Document AI has advanced rapidly and is attracting increasing attention. Yet, while most efforts have focused on document layout analysis (DLA), its generative counterpart, layout generation, remains underexplored. Distinct from traditional graphic layout design and room layout planning, document la

Cited by 0SourcecodeScholar
2026

Prune2Drive: A Plug-and-Play Framework for Accelerating Vision-Language Models in Autonomous Driving

CVPR 2026

Vision-Language Models (VLMs) have emerged as a promising paradigm in autonomous driving (AD), providing a unified framework for perception and decisionmaking. However, their real-world deployment is hindered by significant computational overhead when processing high-resolution, multi-view images. T

Cited by 0SourcecodeScholar
2026

TRivia: Self-supervised Fine-tuning of Vision-Language Models for Table Recognition

CVPR 2026

Table recognition (TR) aims to transform table images into semi-structured representations such as HTML or Markdown.As a core component of document parsing, TR has long relied on supervised learning, with recent efforts dominated by fine-tuning vision-language models (VLMs) using labeled data.While

Cited by 0SourcecodeScholar
2026

The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMs

ICLR 2026poster

Diffusion-based large language models (dLLMs) have recently emerged as a powerful alternative to autoregressive LLMs, offering faster inference and greater interactivity via parallel decoding and bidirectional modeling. However, despite strong performance in code generation and text infilling, we i…

Cited by 0SourcecodeScholar
2026

Variation-aware Vision Token Dropping for Faster Large Vision-Language Models

CVPR 2026

Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding tasks. However, the increasing demand for high-resolution image and long-video understanding results in substantial token counts, consequently leading to reduced inference efficiency. Token com

Cited by 0SourcecodeScholar
2025

Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning

ACL 2025long

Fine-tuning large language models (LLMs) on task-specific data is essential for their effective deployment. As dataset sizes grow, efficiently selecting optimal subsets for training becomes crucial to balancing performance and computational costs. Traditional data selection methods often require fin…

2025

Efficient Multi-modal Large Language Models via Progressive Consistency Distillation

NeurIPS 2025poster

Visual tokens consume substantial computational resources in multi-modal large models (MLLMs), significantly compromising their efficiency. Recent works have attempted to improve efficiency by compressing visual tokens during training, either through modifications to model components or by introduci…

Cited by 0SourceScholar
2025

EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models

NeurIPS 2025poster

Vision-Language-Action (VLA) models, particularly diffusion-based architectures, demonstrate transformative potential for embodied intelligence but are severely hampered by high computational and memory demands stemming from extensive inherent and inference-time redundancies. While existing accelera…

Cited by 0SourceScholar
2025

LEGION: Learning to Ground and Explain for Synthetic Image Detection

ICCV 2025poster

The rapid advancements in generative technology have emerged as a double-edged sword. While offering powerful tools that enhance convenience, they also pose significant social concerns. As defenders, current synthetic image detection methods often lack artifact-level textual interpretability and are…

2025

MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?

NeurIPS 2025poster

While text-to-image models like GPT-4o-Image and FLUX are rapidly proliferating, they often encounter challenges such as hallucination, bias, and the production of unsafe, low-quality output. To effectively address these issues, it is crucial to align these models with desired behaviors based on fee…

Cited by 0SourcecodeScholar
2025

Multi-View Graph Clustering via Node-Guided Contrastive Encoding

ICML 2025poster

Multi-view clustering has gained significant attention for integrating multi-view information in multimedia applications. With the growing complexity of graph data, multi-view graph clustering (MVGC) has become increasingly important. Existing methods primarily use Graph Neural Networks (GNNs) to en…

Cited by 0SourcePDFScholar
2025

OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation

ICCV 2025poster

Retrieval-augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating external knowledge to reduce hallucinations and incorporate up-to-date information without retraining. As an essential part of RAG, external knowledge bases are commonly built by extracting structured data from…

2025

Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanation

NeurIPS 2025poster

With the rapid advancement of Artificial Intelligence Generated Content (AIGC) technologies, synthetic images have become increasingly prevalent in everyday life, posing new challenges for authenticity assessment and detection. Despite the effectiveness of existing methods in evaluating image authen…

Cited by 0SourcecodeScholar
2025

Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More

EMNLP 2025

Vision tokens in multimodal large language models often dominate huge computational overhead due to their excessive length compared to linguistic modality. Abundant recent methods aim to solve this problem with token pruning, which first defines an importance criterion for tokens and then prunes the

2025

Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?

ACL 2025finding

Multimodal large language models (MLLMs) have shown remarkable performance for cross-modal understanding and generation, yet still suffer from severe inference costs. Recently, abundant works have been proposed to solve this problem with token pruning, which identifies the redundant tokens in MLLMs…

Cited by 0SourcePDFScholar
2024

Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph Clustering

AAAI 2024technical

Recently there is a growing focus on graph data, and multi-view graph clustering has become a popular area of research interest. Most of the existing methods are only applicable to homophilous graphs, yet the extensive real-world graph data can hardly fulfill the homophily assumption, where the conn…

Cited by 15SourcePDFScholar
2024

Integrating Vision-Language Semantic Graphs in Multi-View Clustering

IJCAI 2024poster

In recent years, a variety of graph learning-based multi-view clustering (MVC) methods have emerged. However, these methods continue to face challenges in extracting latent features from real-world data, particularly in scenarios involving high-resolution color images and high-dimensional features.…

Cited by 4SourcePDFScholar