← Search

Siya Qi

8 accepted papers

2026

Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score

AAAI 2026technical

Large Language Models (LLMs) have shown improved generation performance through retrieval-augmented generation (RAG) following the retriever-reader paradigm, which supplements model inputs with externally retrieved knowledge. However, prior work often evaluates RAG holistically, assessing the retrie

Cited by 0SourcePDFScholar
2026

Detecting Contextual Hallucinations in Large Language Models with Frequency-Aware Attention

ICML 2026poster

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view of grounding behavior. However, existing approaches typicall…

Cited by 0SourceScholar
2026

Position: Self-Play Only Evolves When Self-Synthetic Pipeline Ensures Learnable Information Gain

ICML 2026poster

Large language models (LLMs) make it plausible to build systems that improve through self-evolving loops, but many existing proposals are better understood as self-play and often plateau quickly. A central failure mode is that the loop synthesises more data without increasing *learnable information*…

Cited by 0SourceScholar
2026

When Thinking Backfires: Mechanistic Insights into Reason-induced Misalignment

ICLR 2026poster

With the growing accessibility and wide adoption of large language models, concerns about their safety and alignment with human values have become paramount. In this paper, we identify a concerning phenomenon: Reasoning-Induced Misalignment (RIM), in which misalignment emerges when reasoning capabil…

Cited by 0SourceScholar
2025

Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases

ACL 2025long

This study evaluates Large Language Models’ (LLMs) ability to simulate non-native-like English use observed in human second language (L2) learners interfered with by their native first language (L1). In dialogue-based interviews, we prompt LLMs to mimic L2 English learners with specific L1s (e.g., J…

2025

EnigmaToM: Improve LLMs’ Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity States

ACL 2025finding

Theory-of-Mind (ToM), the ability to infer others’ perceptions and mental states, is fundamental to human interaction but remains challenging for Large Language Models (LLMs). While existing ToM reasoning methods show promise with reasoning via perceptual perspective-taking, they often rely excessiv…

2025

Evaluating LLMs’ Assessment of Mixed-Context Hallucination Through the Lens of Summarization

ACL 2025finding

With the rapid development of large language models (LLMs), LLM-as-a-judge has emerged as a widely adopted approach for text quality evaluation, including hallucination evaluation. While previous studies have focused exclusively on single-context evaluation (e.g., discourse faithfulness or world fac…

2025

NOVER: Incentive Training for Language Models via Verifier-Free Reinforcement Learning

EMNLP 2025

Recent advances, such as DeepSeek R1-Zero, highlight the effectiveness of incentive training, a reinforcement learning paradigm that computes rewards solely based on the final answer part of a language model’s output, thereby encouraging the generation of intermediate reasoning steps. However, these