← Search

Kyle Montgomery

5 accepted papers

2026

Position: Agent Security Needs Redefinition through a Holistic Framework

ICML 2026poster

Existing definitions of agent security are ambiguous because they do not fully capture the holistic view across agent components. For instance, current work fails to distinguish between potentially legitimate administrative tasks and malicious exploitation of the same command. A command to "delete u…

Cited by 0SourceScholar
2025

JudgeBench: A Benchmark for Evaluating LLM-Based Judges

ICLR 2025poster

LLM-based judges have emerged as a scalable alternative to human evaluation and are increasingly used to assess, compare, and improve models. However, the reliability of LLM-based judges themselves is rarely scrutinized. As LLMs become more advanced, their responses grow more sophisticated, requirin…

2025

VMDT: Decoding the Trustworthiness of Video Foundation Models

NeurIPS 2025poster

As foundation models become more sophisticated, ensuring their trustworthiness becomes increasingly critical; yet, unlike text and image, the video modality still lacks comprehensive trustworthiness benchmarks. We introduce VMDT (Video-Modal DecodingTrust), the first unified platform for evaluating…

Cited by 0SourcecodeScholar
2024

Agent Instructs Large Language Models to be General Zero-Shot Reasoners

ICML 2024poster

We introduce a method to improve the zero-shot reasoning abilities of large language models on general language understanding tasks. Specifically, we build an autonomous agent to instruct the reasoning process of large language models. To enable this, our agent only needs to generate a single set of…

2024

Re-Tuning: Overcoming the Compositionality Limits of Large Language Models with Recursive Tuning

ACL 2024long

We present a new method for large language models to solve compositional tasks. Although they have shown strong performance on traditional language understanding tasks, large language models struggle to solve compositional tasks, where the solution depends on solving smaller instances of the same pr…