← Search

Caifeng Shan

21 accepted papers

2026

Any-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion

ICML 2026poster

While recent multimodal large language models (MLLMs) have made impressive strides, they mostly employ a conventional autoregressive architecture as their backbone, leaving significant room for exploring effective and efficient alternatives in architectural design. Meanwhile, recent studies have suc…

Cited by 0SourceScholar
2026

Beyond Weak Supervision: MLLMs-Guided Graded Knowledge Distillation for Unsupervised Camouflaged Object Detection

CVPR 2026

Most Camouflaged Object Detection (COD) methods rely on costly pixel-level annotations. Recent studies have adopted unsupervised COD (UCOD) to eliminate labeling costs, but still suffer from two issues:1) insufficient supervision, leading to reliance on self-supervised backbone DINO and reduced mode

Cited by 0SourceScholar
2026

Delphi: A Neuro-Symbolic Framework for Individualized, Safe and Interpretable Treatment Recommendation

AAAI 2026technical

Clinical reinforcement learning (RL) holds promise for treatment recommendation but remains hindered by black-box decision processes, limited safety guarantees, and lack of individualized reasoning. We introduce Delphi Engine, the first fully trainable neuro-symbolic causal RL framework for dynamic

Cited by 0SourcePDFScholar
2026

Exposing and Defending the Achilles' Heel of Video Mixture-of-Experts

ICLR 2026poster

Mixture-of-Experts (MoE) has demonstrated strong performance in video understanding tasks, yet its adversarial robustness remains underexplored. Existing attack methods often treat MoE as a unified architecture, overlooking the independent and collaborative weaknesses of key components such as route…

Cited by 0SourcecodeScholar
2026

From Language to Segmentation: Collaborative Category-Guided Unsupervised Camouflaged Object Detection with SAM3

IJCAI 2026

Camouflaged Object Detection (COD) aims to segment objects that are hidden within complex backgrounds. Due to the low visual contrast of camouflaged objects, annotations are costly, motivating unsupervised COD (UCOD) to eliminate labeling expenses. Most UCOD methods follow the “MLLMs + other foundat

Cited by 0Scholar
2026

HiTeA: Hierarchical Temporal Alignment for Training-Free Long-Video Temporal Grounding

ICLR 2026poster

Temporal grounding in long, untrimmed videos is critical for real-world video understanding, yet it remains a challenging task owing to complex temporal structures and pervasive visual redundancy. Existing methods rely heavily on supervised training with task-specific annotations, which inherently l…

Cited by 0SourceScholar
2026

Matting Anything 2: Towards Video Matting for Anything

ICLR 2026poster

Video matting is a crucial task for many applications, but existing methods face significant limitations. They are often domain-specific, focusing primarily on human portraits, and rely on the mask of first frame that is challenging to acquire for transparent or intricate objects like fire or smoke.…

Cited by 0SourceScholar
2026

MedREK: Retrieval-Based Editing for Medical LLMs with Key-Aware Prompts

ICML 2026poster

LLMs hold great promise for healthcare applications, but fast-changing medical knowledge can quickly make their outputs outdated or inaccurate, limiting use in high-stakes settings. Model editing can update LLMs without full retraining, but parameter-based methods often break locality and are risky …

Cited by 0SourceScholar
2026

NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editing

CVPR 2026

Recent video editing models have achieved impressive results, but most still require large-scale paired datasets. Collecting such naturally aligned pairs at scale remains highly challenging and constitutes a critical bottleneck, especially for local video editing data. Existing workarounds transfer

Cited by 0SourcecodeScholar
2026

One-to-More: High-Fidelity Training-Free Anomaly Generation with Attention Control

CVPR 2026

Industrial anomaly detection (AD) is characterized by an abundance of normal images but a scarcity of anomalous ones. Although numerous few-shot anomaly synthesis methods have been proposed to augment anomalous data for downstream AD tasks, most existing approaches require time-consuming training an

Cited by 0SourceScholar
2026

RADAR: Defending RAG Dynamically against Retrieval Corruption

ICML 2026poster

While RAG systems are increasingly deployed in dynamic web search, temporal volatility amplifies their vulnerability to adversarial attacks. Existing static-oriented defenses struggle to handle evolving threats and incur prohibitive storage costs in dynamic settings. We propose RADAR, a framework th…

Cited by 0SourceScholar
2026

RunawayEvil: Jailbreaking the Image-to-Video Generative Models

CVPR 2026

Image-to-Video (I2V) generation represents a frontier in content creation, where models synthesize dynamic visual sequences by jointly reasoning from both image and text prompts. This multimodal grounding enables diverse controllability over video attributes. However, it is precisely this capability

Cited by 0SourcecodeScholar
2026

SpineBench: A Clinically Salient, Level-Aware Benchmark Powered by the SpineMed-450k Corpus

ICLR 2026poster

Spine disorders affect 619 million people globally and are a leading cause of disability, yet AI-assisted diagnosis remains limited by the lack of level-aware, multimodal datasets. Clinical decision-making for spine disorders requires sophisticated reasoning across X-ray, CT, and MRI at specific ver…

Cited by 0SourceScholar
2026

TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning

ICML 2026poster

Visual data is typically a prerequisite for training existing video anomaly detection (VAD) methods. However, obtaining sufficient annotated anomaly data for training is challenging and not scalable due to the rarity of anomaly data and the wide variety of abnormal events. In this work, we advocate …

Cited by 0SourceScholar
2025

GOOD: Training-Free Guided Diffusion Sampling for Out-of-Distribution Detection

NeurIPS 2025poster

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing text-conditioned embeddings, resulting in semantic instability and…

Cited by 0SourceScholar
2025

MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models

NeurIPS 2025spotlight

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to fully reflect the performance of MLLM, lacking a comprehens…

Cited by 0SourcecodeScholar
2025

VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

NeurIPS 2025spotlight

Recent Multimodal Large Language Models (MLLMs) have typically focused on integrating visual and textual modalities, with less emphasis placed on the role of speech in enhancing interaction. However, speech plays a crucial role in multimodal dialogue systems, and implementing high-performance in bot…

Cited by 0SourcecodeScholar
2025

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

CVPR 2025highlight

In the quest for artificial general intelligence, Multi-modal Large Language Models (MLLMs) have emerged as a focal point in recent advancements. However, the predominant focus remains on developing their capabilities in static image understanding. The potential of MLLMs to process sequential visual…

Cited by 368SourcePDFScholar
2024

FedGMKD: An Efficient Prototype Federated Learning Framework through Knowledge Distillation and Discrepancy-Aware Aggregation

NeurIPS 2024poster

Federated Learning (FL) faces significant challenges due to data heterogeneity across distributed clients. To address this, we propose FedGMKD, a novel framework that combines knowledge distillation and differential aggregation for efficient prototype-based personalized FL without the need for publi…

Cited by 1SourcePDFScholar
2023

Benchmark of Physiological Model Based and Deep Learning Based Remote Photoplethysmography in Automotive Applications

ICASSP 2023accepted

Remote photoplethysmography (rPPG) can be used to monitor driver’s cardio-respiratory functions in automotive for improving the safety of driving. To understand the challenges of rPPG in this application, we created a benchmark of latest rPPG algorithms based on the MR-NIRP Car dataset, selecting th…

Cited by 0SourceScholar