← Search

Niels Mündler

7 accepted papers

2026

AutoBaxBuilder: Bootstrapping Code Security Benchmarking

ICML 2026poster

As large language models (LLMs) see wide adoption in software engineering, the reliable assessment of the correctness and security of LLM-generated code is crucial. Notably, prior work showed that LLMs are prone to generating code with security vulnerabilities, highlighting that security is often ov…

Cited by 0SourceScholar
2026

CodeTaste: Can LLMs Generate Human-Level Code Refactorings?

ICML 2026poster

Large language model (LLM)-based coding agents can generate working code, but their solutions often introduce complexity, duplication, and architectural debt. Human developers address such issues through refactoring: behavior-preserving program transformations that improve structure and maintainabil…

Cited by 0SourceScholar
2026

Constrained Decoding of Diffusion LLMs with Context-Free Grammars

ICLR 2026poster

Large language models (LLMs) have shown promising performance across diverse domains. Many practical applications of LLMs, such as code completion and structured data extraction, require adherence to syntactic constraints specified by a formal language. Yet, due to their probabilistic nature, LLM ou…

Cited by 0SourcecodeScholar
2025

BaxBench: Can LLMs Generate Correct and Secure Backends?

ICML 2025spotlight

Automatic program generation has long been a fundamental challenge in computer science. Recent benchmarks have shown that large language models (LLMs) can effectively generate code at the function level, make code edits, and solve algorithmic coding tasks. However, to achieve full automation, LLMs s…

Cited by 2SourcePDFScholar
2025

Black-Box Adversarial Attacks on LLM-Based Code Completion

ICML 2025poster

Modern code completion engines, powered by large language models (LLMs), assist millions of developers with their strong capabilities to generate functionally correct code. Due to this popularity, it is crucial to investigate the security implications of relying on LLM-based code completion. In this…

Cited by 1SourcePDFScholar
2024

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents

NeurIPS 2024poster

Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods. However, while code generation with Large Language Models (LLMs) i…

2024

Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation

ICLR 2024poster

Large language models (large LMs) are susceptible to producing text that contains hallucinated content. An important instance of this problem is self-contradiction, where the LM generates two contradictory sentences within the same context. In this work, we present a comprehensive investigation into…