← Search

Chris Quirk

6 accepted papers

2025

SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?

EMNLP 2025

Large language models (LLMs) are increasingly used in interactive applications, and human evaluation remains the gold standard for assessing their performance in multi-turn conversations. Since human studies are costly, time-consuming, and hard to reproduce, recent work explores using LLMs to simula

Cited by 0SourcePDFScholar
2022

Probing Factually Grounded Content Transfer with Factual Ablation

ACL 2022findings

Despite recent success, large neural models often generate factually incorrect text. Compounding this is the lack of a standard automatic evaluation for factuality–it cannot be meaningfully improved if it cannot be measured. Grounded generation promises a path to solving both of these problems: mode…

Cited by 9SourcePDFScholar
2021

A Controllable Model of Grounded Response Generation

AAAI 2021technical

Current end-to-end neural conversation models inherently lack the flexibility to impose semantic control in the response generation process, often resulting in uninteresting responses. Attempts to boost informativeness alone come at the expense of factual accuracy, as attested by pretrained language…

2021

Text Editing by Command

NAACL 2021long

A prevailing paradigm in neural text generation is one-shot generation, where text is produced in a single step. The one-shot setting is inadequate, however, when the constraints the user wishes to impose on the generated text are dynamic, especially when authoring longer documents. We address this…

2021

When does text prediction benefit from additional context? An exploration of contextual signals for chat and email messages

NAACL 2021industry

Email and chat communication tools are increasingly important for completing daily tasks. Accurate real-time phrase completion can save time and bolster productivity. Modern text prediction algorithms are based on large language models which typically rely on the prior words in a message to predict…

Cited by 12SourcePDFScholar