← Search

Jiao Sun

18 accepted papers

2026

Vibe Checker: Aligning Code Evaluation with Human Preference

ICML 2026poster

Large Language Models (LLMs) have catalyzed vibe coding, where users leverage LLMs to generate and iteratively refine code through natural language interactions until it passes their *vibe check*. *Vibe check* reflects human preference and goes beyond functionality: the solution should feel right, r…

Cited by 0SourceScholar
2025

DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback

NAACL 2025long

Despite their widespread success, Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user’s input text. We introduce DreamSync, a simple yet effective training algorithm that improves T2I models to be faithful to the text input. Dream…

Cited by 47SourcePDFScholar
2025

SkillVerse : Assessing and Enhancing LLMs with Tree Evaluation

ACL 2025long

As language models evolve to tackle complex, multifaceted tasks, their evaluation must adapt to capture this intricacy. A granular, skill-specific understanding of model capabilities can empower researchers to make informed model development plans. In this paper, we introduce SkillVerse, an unsuperv…

2024

Rich Human Feedback for Text-to-Image Generation

CVPR 2024poster

Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However many generated images still suffer from issues such as artifacts/implausibility misalignment with text descriptions…

2023

Dialect-robust Evaluation of Generated Text

ACL 2023long

Text generation metrics that are not robust to dialect variation make it impossible to tell how well systems perform for many groups of users, and can even penalize systems for producing text in lower-resource dialects. In this paper, we introduce a suite of methods to assess whether metrics are dia…

2023

Evaluating Large Language Models on Controlled Generation Tasks

EMNLP 2023long main

While recent studies have looked into the abilities of large language models in various benchmark tasks, including question generation, reading comprehension, multilingual and etc, there have been few studies looking into the controllability of large language models on generation tasks. We present a…

Cited by 0SourcecodeScholar
2023

“Kelly is a Warm Person, Joseph is a Role Model”: Gender Biases in LLM-Generated Reference Letters

EMNLP 2023long findings

Large Language Models (LLMs) have recently emerged as an effective tool to assist individuals in writing various types of content, including professional documents such as recommendation letters. Though bringing convenience, this application also introduces unprecedented fairness concerns. Model-gen…

Cited by 0SourcecodeScholar
2022

Context-Situated Pun Generation

EMNLP 2022main

Previous work on pun generation commonly begins with a given pun word (a pair of homophones for heterographic pun generation and a polyseme for homographic pun generation) and seeks to generate an appropriate pun. While this may enable efficient pun generation, we believe that a pun is most entertai…

2022

ExPUNations: Augmenting Puns with Keywords and Explanations

EMNLP 2022main

The tasks of humor understanding and generation are challenging and subjective even for humans, requiring commonsense and real-world knowledge to master. Puns, in particular, add the challenge of fusing that knowledge with the ability to interpret lexical-semantic ambiguity. In this paper, we presen…

2022

HAGEN: Homophily-Aware Graph Convolutional Recurrent Network for Crime Forecasting

AAAI 2022technical

The goal of the crime forecasting problem is to predict different types of crimes for each geographical region (like a neighborhood or censor tract) in the near future. Since nearby regions usually have similar socioeconomic characteristics which indicate similar crime patterns, recent state-of-the-…

2022

Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts

EMNLP 2022finding

We present a robust methodology for evaluating biases in natural language generation(NLG) systems. Previous works use fixed hand-crafted prefix templates with mentions of various demographic groups to prompt models to generate continuations for bias analysis. These fixed prefix templates could thems…

2021

ESTER: A Machine Reading Comprehension Dataset for Reasoning about Event Semantic Relations

EMNLP 2021main

Understanding how events are semantically related to each other is the essence of reading comprehension. Recent event-centric reading comprehension datasets focus mostly on event arguments or temporal relations. While these tasks partially evaluate machines’ ability of narrative understanding, human…

2021

EventPlus: A Temporal Event Understanding Pipeline

NAACL 2021system demonstrations

We present EventPlus, a temporal event understanding pipeline that integrates various state-of-the-art event understanding components including event trigger and type detection, event argument detection, event duration and temporal relation extraction. Event information, especially event temporal kn…