← Search

Ruotong Pan

3 accepted papers

2026

Does Question Really Matter? The Attribution of Answer Bias in LLM Evaluation

AAAI 2026technical

Multiple-choices question answering (MCQA) has emerged as one of the most popular task formats for large language models (LLMs) evaluation. Unfortunately, there exist substantial evidence that the evaluation of current MCQA benchmarks suffers from significant answer bias, which severely undermines t

Cited by 0SourcePDFScholar
2026

MetaphorVU: Towards Metaphorical Video Understanding

ICML 2026spotlight

Metaphorical videos are prevalent across various real-world scenarios to convey complex ideas, and understanding them typically requires high-order cognitive capabilities. The lack of systematic studies on metaphorical video understanding not only constrains the real-world applicability of MLLMs but…

Cited by 0SourceScholar
2024

Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation

EMNLP 2024main

The rapid development of large language models has led to the widespread adoption of Retrieval-Augmented Generation (RAG), which integrates external knowledge to alleviate knowledge bottlenecks and mitigate hallucinations. However, the existing RAG paradigm inevitably suffers from the impact of flaw…