← Search

Ryan Koo

4 accepted papers

2024

Benchmarking Cognitive Biases in Large Language Models as Evaluators

ACL 2024findings

Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-context learning. In this work, we assemble 16 LLMs encompassing four different size ranges and evaluate their output responses by preference ranking from the other LLMs as eval…

2024

Dynamic Multi-Reward Weighting for Multi-Style Controllable Generation

EMNLP 2024main

Textual style expresses a diverse set of information, including interpersonal dynamics (e.g., formality) and the author’s emotions or attitudes (e.g., disgust). An open question is how language models can be explicitly controlled so that they weave together target styles when generating text: for ex…

2024

Meta-Crafting: Improved Detection of Out-of-Distributed Texts via Crafting Metadata Space (Student Abstract)

AAAI 2024technical

Detecting out-of-distribution (OOD) samples is crucial for robust NLP models. Recent works observe two OOD types: background shifts (style change) and semantic shifts (content change), but existing detection methods vary in effectiveness for each type. To this end, we propose Meta-Crafting, a unifie…

Cited by 1SourcePDFScholar
2023

CoEdIT: Text Editing by Task-Specific Instruction Tuning

EMNLP 2023long findings

We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "Make the sentence simpler" or "Write it in a more neutral style," and outputs the edited text. We present a large langua…

Cited by 0SourcecodeScholar