← Search

Alexander Panfilov

6 accepted papers

2026

ASIDE: Architectural Separation of Instructions and Data in Language Models

ICLR 2026poster

Despite their remarkable performance, large language models lack elementary safety features, making them susceptible to numerous malicious attacks. In particular, previous work has identified the absence of an intrinsic separation between instructions and data as the root cause of the success of pro…

Cited by 0SourcecodeScholar
2026

Adaptive Attacks on Trusted Monitors Subvert AI Control Protocols

ICLR 2026poster

AI control protocols serve as a defense mechanism to stop untrusted LLM agents from causing harm in autonomous settings. Prior work treats this as a security problem, stress testing with exploits that use the deployment context to subtly complete harmful side tasks, such as backdoor insertion. In pr…

Cited by 0SourceScholar
2026

Capability-Based Scaling Trends for LLM-Based Red-Teaming

ICLR 2026poster

As large language models grow in capability and agency, identifying vulnerabilities through red-teaming becomes vital for safe deployment. However, traditional prompt-engineering approaches may prove ineffective once red-teaming turns into a \emph{weak-to-strong} problem, where target models surpass…

Cited by 0SourcecodeScholar
2026

Strategic Dishonesty Can Undermine AI Safety Evaluations of Frontier LLMs

ICLR 2026poster

Large language model (LLM) developers aim for their models to be honest, helpful, and harmless. However, when faced with malicious requests, models are trained to refuse, sacrificing helpfulness. We show that frontier LLMs can develop a preference for \textit{dishonesty} as a new strategy, even when…

Cited by 0SourceScholar
2025

An Interpretable N-gram Perplexity Threat Model for Large Language Model Jailbreaks

ICML 2025poster

A plethora of jailbreaking attacks have been proposed to obtain harmful responses from safety-tuned LLMs. These methods largely succeed in coercing the target output in their original settings, but their attacks vary substantially in fluency and computational effort. In this work, we propose a unifi…

Cited by 0SourcePDFScholar
2024

Provable Compositional Generalization for Object-Centric Learning

ICLR 2024oral

Learning representations that generalize to novel compositions of known concepts is crucial for bridging the gap between human and machine perception. One prominent effort is learning object-centric representations, which are widely conjectured to enable compositional generalization. Yet, it remains…