← Search

Tianyi Men

4 accepted papers

2025

A Troublemaker with Contagious Jailbreak Makes Chaos in Honest Towns

ACL 2025long

With the development of large language models, they are widely used as agents in various fields. A key component of agents is memory, which stores vital information but is susceptible to jailbreak attacks. Existing research mainly focuses on single-agent attacks and shared memory attacks. However, r…

Cited by 0SourcePDFScholar
2025

Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents

ACL 2025long

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with self-correction and generalization. A promising approach is to…

2025

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment

ACL 2025finding

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the alignment process, reward models (RMs) act as a crucial proxy for…

2024

Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models

EMNLP 2024main

Planning, as the core module of agents, is crucial in various fields such as embodied agents, web navigation, and tool using. With the development of large language models (LLMs), some researchers treat large language models as intelligent agents to stimulate and evaluate their planning capabilities…