← Search

Yunjia Qi

7 accepted papers

2026

StoryAlign: Evaluating and Training Reward Models for Story Generation

ICLR 2026poster

Story generation aims to automatically produce coherent, structured, and engaging narratives. Although large language models (LLMs) have significantly advanced text generation, stories generated by LLMs still diverge from human-authored works regarding complex narrative structure and human-aligned p…

Cited by 0SourcecodeScholar
2025

AGENTIF: Benchmarking Large Language Models Instruction Following Ability in Agentic Scenarios

NeurIPS 2025spotlight

Large Language Models (LLMs) have demonstrated advanced capabilities in real-world agentic applications. Growing research efforts aim to develop LLM-based agents to address practical demands, introducing a new challenge: agentic scenarios often involve lengthy instructions with complex constraints,…

Cited by 0SourcecodeScholar
2025

Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems

ACL 2025long

Reward models (RMs) are crucial for the training and inference-time scaling up of large language models (LLMs). However, existing reward models primarily focus on human preferences, neglecting verifiable correctness signals which have shown strong potential in training LLMs. In this paper, we propos…

2025

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following

EMNLP 2025

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing large language models (LLMs), with verification engineering playing a central role. However, best practices for RL in instruction following remain underexplored. In this work, we explore the verification c

2024

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

ICLR 2024poster

The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations. Rather than merely exploring the breadth of LLM abilities, we believe meticulous and thoughtful designs are essential to thorough, unbiased, and applicable evaluations. Given the importance of wor…

2024

MAVEN-FACT: A Large-scale Event Factuality Detection Dataset

EMNLP 2024finding

Event Factuality Detection (EFD) task determines the factuality of textual events, i.e., classifying whether an event is a fact, possibility, or impossibility, which is essential for faithfully understanding and utilizing event knowledge. However, due to the lack of high-quality large-scale data, ev…