Ishana Shastri

Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacy

We present the first evaluation harness that enables any out-of-the-box, local, Large Language Models (LLMs) to play full-press Diplomacy without fine-tuning or specialized training. Previous work required frontier LLMs, or fine-tuning, due to the high complexity and information density of Diplomacy