← Search

Zhengyu Zhao

22 accepted papers

2026

Beyond Pixels: Mining Compressed Domain Artifacts for Efficient AI-Generated Video Detection

ICML 2026poster

With the rapid advancement of high-fidelity video generation models, robust AI-generated video (AIGV) detection has become increasingly needed. While most AIGV detection methods operate in the decoded pixel domain, we observe that detection in the pixel domain inevitably entangles task-irrelevant se…

Cited by 0SourceScholar
2026

Pay Less Attention to Function Words for Free Robustness of Vision-Language Models

ICLR 2026poster

To address the trade-off between robustness and performance for robust VLM, we observe that function words could incur vulnerability of VLMs against cross-modal adversarial attacks, and propose Function-word De-Attention (FDA) accordingly to mitigate the impact of function words. Similar to differen…

Cited by 0SourcecodeScholar
2026

PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems

CVPR 2026

Poisoning input views of 3D reconstruction systems has been recently studied. However, existing studies simply backpropagate adversarial gradients through the 3D reconstruction pipeline as a whole, without uncovering the new vulnerability rooted in specific modules of the pipeline. In this paper, we

Cited by 0SourcecodeScholar
2026

Privacy on the Fly: A Predictive Adversarial Transformation Network for Mobile Sensor Data

AAAI 2026technical

Mobile motion sensors such as accelerometers and gyroscopes are now ubiquitously accessible by third-party apps via standard APIs. While enabling rich functionalities like activity recognition and step counting, this openness has also enabled unregulated inference of sensitive user traits, such as g

Cited by 0SourcePDFScholar
2025

An Optimizable Suffix Is Worth A Thousand Templates: Efficient Black-box Jailbreaking without Affirmative Phrases via LLM as Optimizer

NAACL 2025findings

Despite prior safety alignment efforts, LLMs can still generate harmful and unethical content when subjected to jailbreaking attacks. Existing jailbreaking methods fall into two main categories: template-based and optimization-based methods. The former requires significant manual effort and domain k…

2025

CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP

CVPR 2025poster

Despite its prevalent use in image-text matching tasks in a zero-shot manner, CLIP has been shown to be highly vulnerable to adversarial perturbations added onto images. Recent studies propose to finetune the vision encoder of CLIP with adversarial samples generated on the fly, and show improved rob…

2025

D3: Training-Free AI-Generated Video Detection Using Second-Order Features

ICCV 2025poster

The evolution of video generation techniques, such as Sora, has made it increasingly easy to produce high-fidelity AI-generated videos, raising public concern over the dissemination of synthetic content. However, existing detection methodologies remain limited by their insufficient exploration of te…

2025

Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinement

CVPR 2025poster

Vision Transformers (ViTs) have been widely applied in various computer vision and vision-language tasks. To gain insights into their robustness in practical scenarios, transferable adversarial examples on ViTs have been extensively studied. A typical approach to improving adversarial transferabilit…

2025

Improving Integrated Gradient-based Transferable Adversarial Examples by Refining the Integration Path

AAAI 2025technical

Transferable adversarial examples are known to cause threats in practical, black-box attack scenarios. A notable approach to improving transferability is using integrated gradients (IG), originally developed for model interpretability. In this paper, we find that existing IG-based attacks have limit…

2025

Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection

CVPR 2025poster

Recent studies have shown that large vision-language models (LVLMs) often suffer from the issue of object hallucinations (OH). To mitigate this issue, we introduce an efficient method that edits the model weights based on an unsafe subspace, which we call HalluSpace in this paper. With truthful and…

2025

One-Shot Face Avatar Generation in a Single Forward Pass with Identity Preservation

ICASSP 2025accepted

Face avatar generation has gained significant attention recently. With the help of the Neural Radiance Field (NeRF), existing 3D methods alleviate facial distortion in 2D methods under large pose changes. However, the state-of-the-art 3D methods still require additional optimization for generation o…

Cited by 0SourceScholar
2025

Revisiting Adversarial Patch Defenses on Object Detectors: Unified Evaluation, Large-Scale Dataset, and New Insights

ICCV 2025poster

Developing reliable defenses against patch attacks on object detectors has attracted increasing interest. However, we identify that existing defense evaluations lack a unified and comprehensive framework, resulting in inconsistent and incomplete assessments of current methods. To address this issue,…

2025

TGDrag: Adding Semantic Control into Point-based Image Editing via Text Guidance

ICASSP 2025accepted

Controllable image generation has emerged as a cutting-edge subject of interest. Current interactive point-based image editing frameworks, such as DragGAN, achieve impressive results in fine-grained and controllable image editing. However, relying solely on point-based manipulations can lead to unin…

Cited by 0SourceScholar
2024

Breaking Semantic Artifacts for Generalized AI-generated Image Detection

NeurIPS 2024poster

With the continuous evolution of AI-generated images, the generalized detection of them has become a crucial aspect of AI security. Existing detectors have focused on cross-generator generalization, while it remains unexplored whether these detectors can generalize across different image scenes, e.…

2024

Collapse-Aware Triplet Decoupling for Adversarially Robust Image Retrieval

ICML 2024poster

Adversarial training has achieved substantial performance in defending image retrieval against adversarial examples. However, existing studies in deep metric learning (DML) still suffer from two major limitations: *weak adversary* and *model collapse*. In this paper, we address these two limitations…

2024

Composite Backdoor Attacks Against Large Language Models

NAACL 2024findings

Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may covertly introduce vulnerabilities for downstream tasks. In th…

2024

Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving

CVPR 2024poster

Deep learning-based monocular depth estimation (MDE) extensively applied in autonomous driving is known to be vulnerable to adversarial attacks. Previous physical attacks against MDE models rely on 2D adversarial patches so they only affect a small localized region in the MDE map but fail under vari…

2023

Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compression

ICML 2023poster

Perturbative availability poisoning (PAP) adds small changes to images to prevent their use for model training. Current research adopts the belief that practical and effective approaches to countering such poisons do not exist. In this paper, we argue that it is time to abandon this belief. We prese…

2023

Is Adversarial Training Really a Silver Bullet for Mitigating Data Poisoning?

ICLR 2023top-25%

Indiscriminate data poisoning can decrease the clean test accuracy of a deep learning model by slightly perturbing its training samples. There is a consensus that such poisons can hardly harm adversarially-trained (AT) models when the adversarial training budget is no less than the poison budget, i.…

2021

On Success and Simplicity: A Second Look at Transferable Targeted Attacks

NeurIPS 2021poster

Achieving transferability of targeted attacks is reputed to be remarkably difficult. The current state of the art has resorted to resource-intensive solutions that necessitate training model(s) for each target class with additional data. In our investigation, we find, however, that simple transferab…

2020

Towards Large Yet Imperceptible Adversarial Image Perturbations With Perceptual Color Distance

CVPR 2020poster

The success of image perturbations that are designed to fool image classifier is assessed in terms of both adversarial effect and visual imperceptibility. The conventional assumption on imperceptibility is that perturbations should strive for tight Lp-norm bounds in RGB space. In this work, we drop…

Cited by 179PDFcodeScholar