Rundong Lv

Gradients with Respect to Semantics Preserving Embeddings Tell the Uncertainty of Large Language Model

Uncertainty quantification (UQ) is an important technique for ensuring the trustworthiness of LLMs, given their tendency to hallucinate. Existing state-of-the-art UQ approaches for free-form generation rely heavily on sampling, which incurs high computational cost and variance. In this work, we prop…