Ido Amit

Evaluating LLM Uncertainty in Long-Form Generation Using Deterministic Ground Truth

As LLMs generate increasingly long outputs, effective uncertainty estimation must identify errors at fine-grained levels rather than discard entire responses. While such methods exist, evaluating uncertainty at any resolution (token to an entire generation) is challenging and highly sensitive to lab…