Kyle Cox

Mapping from Meaning: Addressing the Miscalibration of Prompt-Sensitive Language Models

An interesting behavior in large language models (LLMs) is prompt sensitivity. When provided with different but semantically equivalent versions of the same prompt, models may produce very different distributions of answers. This suggests that the uncertainty reflected in a model's output distributi…