Thayne Walker

Draft-Conditioned Constrained Decoding for Structured Generation in LLMs

Large language models (LLMs) are increasingly used to generate executable outputs, JSON objects, and API calls, where a single syntax error can make the output unusable. Constrained decoding enforces validity token-by-token via masking and renormalization, but it can distort generation when the mode…