← Search

Richard Fang

3 accepted papers

2025

Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents

NAACL 2025findings

Large Language Model (LLM) agents exhibit remarkable performance across diverse applications by using external tools to interact with environments. However, integrating external tools introduces security risks, such as indirect prompt injection (IPI) attacks. Despite defenses designed for IPI attack…

2025

CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities

ICML 2025spotlight

Large language model (LLM) agents are increasingly capable of autonomously conducting cyberattacks, posing significant threats to existing applications. This growing risk highlights the urgent need for a real-world benchmark to evaluate the ability of LLM agents to exploit web application vulnerabil…

2024

Removing RLHF Protections in GPT-4 via Fine-Tuning

NAACL 2024short

As large language models (LLMs) have increased in their capabilities, so doestheir potential for dual use. To reduce harmful outputs, produces and vendors ofLLMs have used reinforcement learning with human feedback (RLHF). In tandem,LLM vendors have been increasingly enabling fine-tuning of their mo…

Cited by 104SourcePDFScholar