2024
Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators
ACL 2024long
Large Language Models (LLMs) tend to be unreliable on fact-based answers.To address this problem, NLP researchers have proposed a range of techniques to estimate LLM’s confidence over facts. However, due to the lack of a systematic comparison, it is not clear how the different methods compare to one…