AAAI 2026technical0 citations
Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacy
Alexander Duffy, Samuel J Paech, Ishana Shastri, Elizabeth Karpinski, Baptiste Alloui-Cros, Tyler Marques, Matthew Lyle Olson
Abstract
We present the first evaluation harness that enables any out-of-the-box, local, Large Language Models (LLMs) to play full-press Diplomacy without fine-tuning or specialized training. Previous work required frontier LLMs, or fine-tuning, due to the high complexity and information density of Diplomacy
BibTeX
@inproceedings{aaai2026_democratizingdip,
title = {Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacy},
author = {Alexander Duffy and Samuel J Paech and Ishana Shastri and Elizabeth Karpinski and Baptiste Alloui-Cros and Tyler Marques and Matthew Lyle Olson},
booktitle = {AAAI 2026},
year = {2026}
}