← Search

Zhihang Fu

14 accepted papers

2026

Interact-RAG: Reason and Interact with the Corpus, Beyond Black-Box Retrieval

ICLR 2026poster

Retrieval-Augmented Generation (RAG) has significantly enhanced LLMs by incorporating external information. However, prevailing agentic RAG approaches are constrained by a critical limitation: they treat the retrieval process as a black-box querying operation. This confines agents' actions to query…

Cited by 0SourceScholar
2025

Controlling Thinking Speed in Reasoning Models

NeurIPS 2025spotlight

Human cognition is theorized to operate in two modes: fast, intuitive System 1 thinking and slow, deliberate System 2 thinking. While current Large Reasoning Models (LRMs) excel at System 2 thinking, their inability to perform fast thinking leads to high computational overhead and latency. In this w…

Cited by 0SourceScholar
2025

Human-centered Interactive Learning via MLLMs for Text-to-Image Person Re-identification

CVPR 2025poster

Despite remarkable advancements in text-to-image person re-identification (TIReID) facilitated by the breakthrough of cross-modal embedding models, existing methods often struggle to distinguish challenging candidate images due to intrinsic limitations, such as network architecture and data quality.…

2025

ROPO: Robust Preference Optimization for Large Language Models

ICML 2025poster

The prevalent noise in the preference data unavoidably poses significant challenges to the preference alignment of large language models (LLMs). Existing efforts for this problem either marginally alleviate the impact of noise without noise reduction, or rely on external LLMs that incur substantial…

Cited by 2SourcePDFScholar
2025

ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL

ICLR 2025poster

Despite the significant advancements in Text-to-SQL (Text2SQL) facilitated by large language models (LLMs), the latest state-of-the-art techniques are still trapped in the in-context learning of closed-source LLMs (e.g., GPT-4), which limits their applicability in open scenarios. To address this ch…

2025

Structure-aware Domain Knowledge Injection for Large Language Models

ACL 2025long

This paper introduces a pioneering methodology, termed StructTuning, to efficiently transform foundation Large Language Models (LLMs) into domain specialists. It significantly reduces the training corpus needs to a mere 5% while achieving an impressive 100% of traditional knowledge injection perform…

2024

Delving into the Reversal Curse: How Far Can Large Language Models Generalize?

NeurIPS 2024poster

While large language models (LLMs) showcase unprecedented capabilities, they also exhibit certain inherent limitations when facing seemingly trivial tasks. A prime example is the recently debated "reversal curse", which surfaces when models, having been trained on the fact "A is B", struggle to gen…

2024

Enhancing LLM’s Cognition via Structurization

NeurIPS 2024poster

When reading long-form text, human cognition is complex and structurized. While large language models (LLMs) process input contexts through a causal and sequential perspective, this approach can potentially limit their ability to handle intricate and complex inputs effectively. To enhance LLM’s cogn…

2024

INSIDE: LLMs' Internal States Retain the Power of Hallucination Detection

ICLR 2024poster

Knowledge hallucination have raised widespread concerns for the security and reliability of deployed LLMs. Previous efforts in detecting hallucinations have been employed at logit-level uncertainty estimation or language-level self-consistency evaluation, where the semantic information is inevitably…

2024

Rethinking Out-of-Distribution Detection on Imbalanced Data Distribution

NeurIPS 2024poster

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by the inherent imbalance of in-distribution (ID) data, which c…

2023

Category-Extensible Out-of-Distribution Detection via Hierarchical Context Descriptions

NeurIPS 2023poster

The key to OOD detection has two aspects: generalized feature representation and precise category description. Recently, vision-language models such as CLIP provide significant advances in both two issues, but constructing precise category descriptions is still in its infancy due to the absence of u…

2023

Optimal Parameter and Neuron Pruning for Out-of-Distribution Detection

NeurIPS 2023poster

For a machine learning model deployed in real world scenarios, the ability of detecting out-of-distribution (OOD) samples is indispensable and challenging. Most existing OOD detection methods focused on exploring advanced training skills or training-free tricks to prevent the model from yielding ove…

Cited by 5SourcePDFScholar
2023

Uncertainty-aware Unsupervised Multi-Object Tracking

ICCV 2023poster

Without manually annotated identities, unsupervised multi-object trackers are inferior to learning reliable feature embeddings. It causes the similarity-based inter-frame association stage also be error-prone, where an uncertainty problem arises. The frame-by-frame accumulated uncertainty prevents t…

Cited by 24PDFcodeScholar
2020

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

CVPR 2020poster

Based on the framework of multiple instance learning (MIL), tremendous works have promoted the advances of weakly supervised object detection (WSOD). However, most MIL-based methods tend to localize instances to their discriminative parts instead of the whole content. In this paper, we propose a spa…

Cited by 95PDFScholar