2023
A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing
EMNLP 2023long findings
We evaluate a range of recent LLMs on English creative writing, a challenging and complex task that requires imagination, coherence, and style. We use a difficult, open-ended scenario chosen to avoid training data reuse: an epic narration of a single combat between Ignatius J. Reilly, the protagonis…