← Search

John Frederick Wieting

5 accepted papers

2024

PostMark: A Robust Blackbox Watermark for Large Language Models

EMNLP 2024main

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature—or watermark—during the model’s decoding process. Most existing watermarking methods require access to the underlying LLM’s logits, which LLM API providers are loath to share due to fears of model dis…

2023

Evaluating Large Language Models on Controlled Generation Tasks

EMNLP 2023long main

While recent studies have looked into the abilities of large language models in various benchmark tasks, including question generation, reading comprehension, multilingual and etc, there have been few studies looking into the controllability of large language models on generation tasks. We present a…

Cited by 0SourcecodeScholar
2023

Evaluating and Modeling Attribution for Cross-Lingual Question Answering

EMNLP 2023long main

Trustworthy answer content is abundant in many high-resource languages and is instantly accessible through question answering systems — yet this content can be hard to access for those that do not speak these languages. The leap forward in cross-lingual modeling quality offered by generative languag…

Cited by 0SourceScholar
2023

Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense

NeurIPS 2023poster

The rise in malicious usage of large language models, such as fake content creation and academic plagiarism, has motivated the development of approaches that identify AI-generated text, including those based on watermarking or outlier detection. However, the robustness of these detection algorithms…

2023

XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages

EMNLP 2023long findings

Data scarcity is a crucial issue for the development of highly multilingual NLP systems. Yet for many under-represented languages (ULs) --- languages for which NLP research is particularly far behind in meeting user needs --- it is feasible to annotate small amounts of data. Motivated by this, we pr…

Cited by 0SourcecodeScholar