← Search

Jiongxiao Wang

12 accepted papers

2025

Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset

ICLR 2025poster

Machine unlearning has emerged as an effective strategy for forgetting specific information in the training data. However, with the increasing integration of visual data, privacy concerns in Vision Language Models (VLMs) remain underexplored. To address this, we introduce Facial Identity Unlearning…

2025

Robust Representation Consistency Model via Contrastive Denoising

ICLR 2025poster

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently, diffusion models have been successfully employed for randomized sm…

2025

Test-time Backdoor Mitigation for Black-Box Large Language Models with Defensive Demonstrations

NAACL 2025findings

Existing studies in backdoor defense have predominantly focused on the training phase, overlooking the critical aspect of testing time defense. This gap becomes pronounced in the context of Large Language Models (LLMs) deployed as Web Services, which typically offer only black-box access, rendering…

Cited by 24SourcePDFScholar
2024

BackdoorAlign: Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment

NeurIPS 2024poster

Despite the general capabilities of Large Language Models (LLMs) like GPT-4, these models still request fine-tuning or adaptation with customized data when meeting the specific business demands and intricacies of tailored use cases. However, this process inevitably introduces new safety threats, par…

Cited by 4SourcePDFScholar
2024

Consistency Purification: Effective and Efficient Diffusion Purification towards Certified Robustness

NeurIPS 2024poster

Diffusion Purification, purifying noised images with diffusion models, has been widely used for enhancing certified robustness via randomized smoothing. However, existing frameworks often grapple with the balance between efficiency and effectiveness. While the Denoising Diffusion Probabilistic Model…

Cited by 0SourcePDFScholar
2024

Conversational Drug Editing Using Retrieval and Domain Feedback

ICLR 2024poster

Recent advancements in conversational large language models (LLMs), such as ChatGPT, have demonstrated remarkable promise in various domains, including drug discovery. However, existing works mainly focus on investigating the capabilities of conversational LLMs on chemical reactions and retrosynthes…

Cited by 22SourcePDFScholar
2024

RLHFPoison: Reward Poisoning Attack for Reinforcement Learning with Human Feedback in Large Language Models

ACL 2024long

Reinforcement Learning with Human Feedback (RLHF) is a methodology designed to align Large Language Models (LLMs) with human preferences, playing an important role in LLMs alignment. Despite its advantages, RLHF relies on human annotators to rank the text, which can introduce potential security vuln…

2023

A Critical Revisit of Adversarial Robustness in 3D Point Cloud Recognition with Diffusion-Driven Purification

ICML 2023poster

3D point clouds serve as a crucial data representation in numerous real-world applications such as autonomous driving, robotics, and medical imaging. While the advancements in deep learning have spurred the utilization of 3D point clouds, deep models are notoriously vulnerable to adversarial attacks…

Cited by 14SourcePDFScholar
2023

Defending against Adversarial Audio via Diffusion Model

ICLR 2023poster

Deep learning models have been widely used in commercial acoustic systems in recent years. However, adversarial audio examples can cause abnormal behaviors for those acoustic systems, while being hard for humans to perceive. Various methods, such as transformation-based defenses and adversarial trai…

2023

DensePure: Understanding Diffusion Models for Adversarial Robustness

ICLR 2023poster

Diffusion models have been recently employed to improve certified robustness through the process of denoising. However, the theoretical understanding of why diffusion models are able to improve the certified robustness is still lacking, preventing from further improvement. In this study, we close…

Cited by 43SourcePDFScholar
2023

On the Exploitability of Instruction Tuning

NeurIPS 2023poster

Instruction tuning is an effective technique to align large language models (LLMs) with human intent. In this work, we investigate how an adversary can exploit instruction tuning by injecting specific instruction-following examples into the training data that intentionally changes the model's behavi…

2022

Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack

ICML 2022spotlight

The AutoAttack (AA) has been the most reliable method to evaluate adversarial robustness when considerable computational resources are available. However, the high computational cost (e.g., 100 times more than that of the project gradient descent attack) makes AA infeasible for practitioners with li…