2025
Waste Not, Want Not; Recycled Gumbel Noise Improves Consistency in Natural Language Generation
NAACL 2025long
Consistency in the output of language models is critical for their reliability and practical utility. Due to their training objective, language models learn to model the full space of possible continuations, leading to outputs that can vary significantly in style, content, and tone, even for similar…