← Search

Chris Brockett

8 accepted papers

2024

Automatic Bug Detection in LLM-Powered Text-Based Games Using LLMs

ACL 2024findings

Advancements in large language models (LLMs) are revolutionizing interactive game design, enabling dynamic plotlines and interactions between players and non-player characters (NPCs). However, LLMs may exhibit flaws such as hallucinations, forgetfulness, or misinterpretations of prompts, causing log…

Cited by 2SourcePDFScholar
2022

A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation

ACL 2022long

Large pretrained generative models like GPT-3 often suffer from hallucinating non-existent or incorrect content, which undermines their potential merits in real applications. Existing work usually attempts to detect these hallucinations based on a corresponding oracle reference at a sentence or docu…

2022

RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling

AAAI 2022technical

Recent advances in large-scale pre-training such as GPT-3 allow seemingly high quality text to be generated from a given prompt. However, such generation systems often suffer from problems of hallucinated facts, and are not inherently designed to incorporate useful external information. Grounded gen…

2021

A Controllable Model of Grounded Response Generation

AAAI 2021technical

Current end-to-end neural conversation models inherently lack the flexibility to impose semantic control in the response generation process, often resulting in uninteresting responses. Attempts to boost informativeness alone come at the expense of factual accuracy, as attested by pretrained language…

2021

Contextualized Perturbation for Textual Adversarial Attack

NAACL 2021long

Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness. Existing techniques of generating such examples are typically driven by local heuristic rules that are agnostic to the context, often resulting in un…

2021

Text Editing by Command

NAACL 2021long

A prevailing paradigm in neural text generation is one-shot generation, where text is produced in a single step. The one-shot setting is inadequate, however, when the constraints the user wishes to impose on the generated text are dynamic, especially when authoring longer documents. We address this…

2019

Vision-Based Navigation With Language-Based Assistance via Imitation Learning With Indirect Intervention

CVPR 2019poster

We present Vision-based Navigation with Language-based Assistance (VNLA), a grounded vision-language task where an agent with visual perception is guided via language to find objects in photorealistic indoor environments. The task emulates a real-world scenario in that (a) the requester may not know…

Cited by 144PDFcodeScholar
2018

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

NeurIPS 2018poster

Responses generated by neural conversational models tend to lack informativeness and diversity. We present Adversarial Information Maximization (AIM), an adversarial learning framework that addresses these two related but distinct problems. To foster response diversity, we leverage adversarial train…

Cited by 326SourcePDFScholar