← Search

Shiyu Ni

5 accepted papers

2026

Annotation-Efficient Honesty Alignment via Confidence Elicitation and Calibration

ICLR 2026poster

Honesty alignment—the ability of large language models (LLMs) to recognize their knowledge boundaries and express calibrated confidence—is essential for trustworthy deployment. Existing methods either rely on training-free confidence estimation (e.g., token probabilities, self-consistency) or traini…

Cited by 0SourceScholar
2025

Do LVLMs Know What They Know? A Systematic Study of Knowledge Boundary Perception in LVLMs

EMNLP 2025

Large Vision-Language Models (LVLMs) demonstrate strong visual question answering (VQA) capabilities but are shown to hallucinate. A reliable model should perceive its knowledge boundaries—knowing what it knows and what it does not. This paper investigates LVLMs’ perception of their knowledge bounda

Cited by 0SourcePDFScholar
2025

Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness

ICLR 2025poster

As the modern tools of choice for text understanding and generation, large language models (LLMs) are expected to accurately output answers by leveraging the input context. This requires LLMs to possess both context-faithfulness and factual accuracy. While extensive efforts aim to reduce hallucinati…

Cited by 3SourcePDFScholar
2025

Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception

ACL 2025long

Large language models (LLMs) exhibit impressive performance across diverse tasks but often struggle to accurately gauge their knowledge boundaries, leading to confident yet incorrect responses. This paper explores leveraging LLMs’ internal states to enhance their perception of knowledge boundaries f…

Cited by 0SourcePDFScholar
2024

When Do LLMs Need Retrieval Augmentation? Mitigating LLMs’ Overconfidence Helps Retrieval Augmentation

ACL 2024findings

Large Language Models (LLMs) have been found to have difficulty knowing they do not possess certain knowledge and tend to provide specious answers in such cases. Retrieval Augmentation (RA) has been extensively studied to mitigate LLMs’ hallucinations. However, due to the extra overhead and unassure…