← Search

Yanjun Chen

6 accepted papers

2025

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents

ACL 2025finding

The development of autonomous agents increasingly relies on Multimodal Language Models (MLMs) to perform tasks described in natural language with GUI environments, such as websites, desktop computers, or mobile phones. Existing benchmarks for MLM agents in interactive environments are limited by the…

2025

PricingLogic: Evaluating LLMs Reasoning on Complex Tourism Pricing Tasks

EMNLP 2025

We present PricingLogic, the first benchmarkthat probes whether Large Language Mod-els (LLMs) can reliably automate tourism-booking prices when multiple, overlapping farerules apply. Travel agencies are eager to of-fload this error-prone task to AI systems; how-ever, deploying LLMs without verified

2025

Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning

ACL 2025finding

Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought (CoT) prompting. However, CoT prompting greatly increases computational demands, which has prompted growing interest in distilling CoT capabilities into Small Language Models (SLMs). This study systematically examines the…

2024

The Accuracy Paradox in RLHF: When Better Reward Models Don’t Yield Better Language Models

EMNLP 2024main

Reinforcement Learning from Human Feedback significantly enhances Natural Language Processing by aligning language models with human expectations. A critical factor in this alignment is the strength of reward models used during training. This study explores whether stronger reward models invariably…

2023

VIMA: Robot Manipulation with Multimodal Prompts

ICML 2023poster

Prompt-based learning has emerged as a successful paradigm in natural language processing, where a single general-purpose language model can be instructed to perform any task specified by input prompts. Yet task specification in robotics comes in various forms, such as imitating one-shot demonstrati…

2021

Embracing Uncertainty: Decoupling and De-Bias for Robust Temporal Grounding

CVPR 2021poster

Temporal grounding aims to localize temporal boundaries within untrimmed videos by language queries, but it faces the challenge of two types of inevitable human uncertainties: query uncertainty and label uncertainty. The two uncertainties stem from human subjectivity, leading to limited generalizati…

Cited by 62PDFScholar