← Search

Runing Yang

2 accepted papers

2024

Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization?

EMNLP 2024main

Text summarization, a key natural language generation (NLG) task, is vital in various domains. However, the high cost of inaccurate summaries in risk-critical applications, particularly those involving human-in-the-loop decision-making, raises concerns about the reliability of uncertainty estimation…

2024

InternalInspector I2: Robust Confidence Estimation in LLMs through Internal States

EMNLP 2024finding

Despite their vast capabilities, Large Language Models (LLMs) often struggle with generating reliable outputs, frequently producing high-confidence inaccuracies known as hallucinations. Addressing this challenge, our research introduces InternalInspector, a novel framework designed to enhance confid…

Cited by 2SourcePDFScholar