← Search

Zifan Peng

4 accepted papers

2026

JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Models

ICLR 2026poster

Large Audio Language Models (LALMs) integrate the audio modality directly into the model, rather than converting speech into text and inputting text to Large Language Models (LLMs). While jailbreak attacks on LLMs have been extensively studied, the security of LALMs with audio modalities remains lar…

Cited by 0SourcecodeScholar
2026

NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents

ICML 2026poster

Recent advances in coding agents suggest rapid progress toward autonomous software development, yet existing benchmarks primarily evaluate short-horizon behaviors such as localized code generation, scaffolded completion, or repository repair, leaving it unclear whether agents can sustain coherent re…

Cited by 0SourceScholar
2025

CHASM: Unveiling Covert Advertisements on Chinese Social Media

NeurIPS 2025poster

Current benchmarks for evaluating large language models (LLMs) in social media moderation completely overlook a serious threat: covert advertisements, which disguise themselves as regular posts to deceive and mislead consumers into making purchases, leading to significant ethical and legal concerns.…

Cited by 0SourceScholar
2025

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines

NeurIPS 2025poster

Large language models (LLMs) have demonstrated remarkable proficiency in mainstream academic disciplines such as mathematics, physics, and computer science. However, human knowledge encompasses over 200 specialized disciplines, far exceeding the scope of existing benchmarks. The capabilities of LLMs…

Cited by 215SourceScholar