← Search

Weichen Yu

9 accepted papers

2026

Omni-Attack: Adversarial Attacks on Open-Ended VQA in Black-Box Multimodal LLMs

CVPR 2026

Multimodal large language models (MLLMs) have achieved remarkable success across diverse applications, from autonomous driving to document understanding. As these models are deployed in safety-critical contexts, understanding their adversarial robustness becomes crucial. However, current evaluations

Cited by 0SourcecodeScholar
2026

SecCodePRM: A Process Reward Model for Code Security

ICML 2026poster

Large Language Models are rapidly becoming core components of modern software development workflows, yet ensuring code security remains challenging. Existing vulnerability detection pipelines either rely on static analyzers or use LLM/GNN-based detectors trained with coarse program-level supervision…

Cited by 0SourceScholar
2026

Steal the Patch Size: Adversarially Manipulate Vision Language Models

ICML 2026poster

We present a black-box model-stealing attack that recovers private vision-tokenizer configurations of deployed vision-language models (VLMs), including the visual patch size and input preprocessing pipeline. The key idea is a task-level side channel induced by ViT-style patchification: when a synthe…

Cited by 0SourceScholar
2025

GOOD: Training-Free Guided Diffusion Sampling for Out-of-Distribution Detection

NeurIPS 2025poster

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing text-conditioned embeddings, resulting in semantic instability and…

Cited by 0SourceScholar
2025

Learning Fine-Grained Alignment for Aerial Vision-Dialog Navigation

AAAI 2025technical

Aerial Vision-Dialog Navigation (AVDN) is a new task that requires drones to navigate to a target location based on human-robot dialog history. This paper focuses on the critical fine-grained cross-modal alignment problem in AVDN, requiring the drone to align language entities with visual landmarks…

2024

Efficient LLM Jailbreak via Adaptive Dense-to-sparse Constrained Optimization

NeurIPS 2024poster

Recent research indicates that large language models (LLMs) are susceptible to jailbreaking attacks that can generate harmful content. This paper introduces a novel token-level attack method, Adaptive Dense-to-Sparse Constrained Optimization (ADC), which has been shown to successfully jailbreak mult…

2024

Metric from Human: Zero-shot Monocular Metric Depth Estimation via Test-time Adaptation

NeurIPS 2024poster

Monocular depth estimation (MDE) is fundamental for deriving 3D scene structures from 2D images. While state-of-the-art monocular relative depth estimation (MRDE) excels in estimating relative depths for in-the-wild images, current monocular metric depth estimation (MMDE) approaches still face chall…

Cited by 4SourcePDFScholar
2023

Bag of Tricks for Training Data Extraction from Language Models

ICML 2023poster

With the advance of language models, privacy protection is receiving more attention. Training data extraction is therefore of great importance, as it can serve as a potential tool to assess privacy leakage. However, due to the difficulty of this task, most of the existing methods are proof-of-concep…

2022

Regularized Graph Structure Learning with Semantic Knowledge for Multi-variates Time-Series Forecasting

IJCAI 2022poster

Multivariate time-series forecasting is a critical task for many applications, and graph time-series network is widely studied due to its capability to capture the spatial-temporal correlation simultaneously. However, most existing works focus more on learning with the explicit prior graph structure…