← Search

Jingxuan He

18 accepted papers

2026

CyberCycle: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities

ICML 2026poster

AI has the potential to transform cybersecurity by enabling systems that can autonomously detect, analyze, and remediate software vulnerabilities. However, existing cybersecurity evaluations of AI systems are limited in scale or scope, and fail to capture the end-to-end lifecycle of real-world softw…

Cited by 0SourceScholar
2026

CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale

ICLR 2026oral

AI agents have significant potential to reshape cybersecurity, making a thorough assessment of their capabilities critical. However, existing evaluations fall short, because they are based on small-scale benchmarks and only measure static outcomes, failing to capture the full, dynamic range of real-…

Cited by 0SourceScholar
2026

OpenSage: Self-programming Agent Generation Engine

ICML 2026poster

Agent development kits (ADKs) provide effective platforms and tooling for constructing agents, and their designs are critical to the constructed agents' performance, especially the functionality for agent topology, tools, and memory. However, current ADKs either lack sufficient functional support or…

Cited by 0SourceScholar
2026

Position: Agent Security Needs Redefinition through a Holistic Framework

ICML 2026poster

Existing definitions of agent security are ambiguous because they do not fully capture the holistic view across agent components. For instance, current work fails to distinguish between potentially legitimate administrative tasks and malicious exploitation of the same command. A command to "delete u…

Cited by 0SourceScholar
2026

SecCodePRM: A Process Reward Model for Code Security

ICML 2026poster

Large Language Models are rapidly becoming core components of modern software development workflows, yet ensuring code security remains challenging. Existing vulnerability detection pipelines either rely on static analyzers or use LLM/GNN-based detectors trained with coarse program-level supervision…

Cited by 0SourceScholar
2026

VERINA: Benchmarking Verifiable Code Generation

ICLR 2026poster

Large language models (LLMs) are increasingly integrated in software development, but ensuring correctness in LLM-generated code remains challenging and often requires costly manual review. Verifiable code generation---jointly generating code, specifications, and proofs of code-specification alignme…

Cited by 0SourcecodeScholar
2025

BaxBench: Can LLMs Generate Correct and Secure Backends?

ICML 2025spotlight

Automatic program generation has long been a fundamental challenge in computer science. Recent benchmarks have shown that large language models (LLMs) can effectively generate code at the function level, make code edits, and solve algorithmic coding tasks. However, to achieve full automation, LLMs s…

Cited by 2SourcePDFScholar
2025

Black-Box Adversarial Attacks on LLM-Based Code Completion

ICML 2025poster

Modern code completion engines, powered by large language models (LLMs), assist millions of developers with their strong capabilities to generate functionally correct code. Due to this popularity, it is crucial to investigate the security implications of relying on LLM-based code completion. In this…

Cited by 1SourcePDFScholar
2025

Mind the Gap: A Practical Attack on GGUF Quantization

ICML 2025poster

With the increasing size of frontier LLMs, post-training quantization has become the standard for memory-efficient deployment. Recent work has shown that basic rounding-based quantization schemes pose security risks, as they can be exploited to inject malicious behaviors into quantized models that r…

2025

Position: Formal Mathematical Reasoning—A New Frontier in AI

ICML 2025spotlight

AI for Mathematics (AI4Math) is intellectually intriguing and is crucial for AI-driven system design and verification. Extensive efforts on AI4Math have mirrored techniques in NLP, in particular, training large language models on carefully curated math datasets in text form. As a complementary yet l…

Cited by 0SourcePDFScholar
2025

Shaping a Stabilized Video by Mitigating Unintended Changes for Concept-Augmented Video Editing

IJCAI 2025

Text-driven video editing powered by generative diffusion models holds significant promise for applications spanning film production, advertising, and beyond. However, the limited expressiveness of pre-trained word embeddings often restricts nuanced edits, especially when targeting novel concepts wi

2024

Instruction Tuning for Secure Code Generation

ICML 2024poster

Modern language models (LMs) have gained widespread acceptance in everyday and professional contexts, particularly in programming. An essential procedure enabling this adoption is instruction tuning, which substantially enhances LMs' practical utility by training them to follow user instructions and…

2024

Progressive Feature Self-Reinforcement for Weakly Supervised Semantic Segmentation

AAAI 2024technical

Compared to conventional semantic segmentation with pixel-level supervision, weakly supervised semantic segmentation (WSSS) with image-level labels poses the challenge that it commonly focuses on the most discriminative regions, resulting in a disparity between weakly and fully supervision scenarios…

2024

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents

NeurIPS 2024poster

Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods. However, while code generation with Large Language Models (LLMs) i…

2024

Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation

ICLR 2024poster

Large language models (large LMs) are susceptible to producing text that contains hallucinated content. An important instance of this problem is self-contradiction, where the LM generates two contradictory sentences within the same context. In this work, we present a comprehensive investigation into…

2022

On Distribution Shift in Learning-based Bug Detectors

ICML 2022spotlight

Deep learning has recently achieved initial success in program analysis tasks such as bug detection. Lacking real bugs, most existing works construct training and test data by injecting synthetic bugs into correct programs. Despite achieving high test accuracy (e.g., >90%), the resulting bug detecto…

2021

TFix: Learning to Fix Coding Errors with a Text-to-Text Transformer

ICML 2021spotlight

The problem of fixing errors in programs has attracted substantial interest over the years. The key challenge for building an effective code fixing tool is to capture a wide range of errors and meanwhile maintain high accuracy. In this paper, we address this challenge and present a new learning-base…