← Search

Qi Cao

24 accepted papers

2026

AuditAgent: LLM Agent for Risks Auditing in Recommender Systems

AAAI 2026technical

Auditing recommendation systems has attracted growing attention due to increasing concerns over filter bubbles, unfairness, and data misuse. A common approach is sock-puppet auditing, where autonomous agents interact with platforms to reveal risks. However, existing approaches rely on hard-coded age

Cited by 0SourcePDFScholar
2026

GoalRank: Group-Relative Optimization for a Large Ranking Model

ICLR 2026poster

Mainstream ranking approaches typically follow a Generator–Evaluator two-stage paradigm, where a generator produces candidate lists and an evaluator selects the best one. Recent work has attempted to enhance performance by expanding the number of candidate lists, for example, through multi-generator…

Cited by 0SourcecodeScholar
2026

Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoning

ICML 2026poster

Model routing chooses which language model to use for each query. By sending easy queries to cheaper models and hard queries to stronger ones, it can significantly reduce inference cost while maintaining high accuracy. However, most existing routers treat this as a fixed choice among a small set of …

Cited by 0SourceScholar
2026

SELF-HARMONY: LEARNING TO HARMONIZE SELF-SUPERVISION AND SELF-PLAY IN TEST-TIME REINFORCEMENT LEARNING

ICLR 2026poster

Test-time reinforcement learning (TTRL) offers a label-free paradigm for adapting models using only synthetic signals at inference, but its success hinges on constructing reliable learning signals. Standard approaches such as majority voting often collapse to spurious yet popular answers. We introdu…

Cited by 0SourceScholar
2025

Answer When Needed, Forget When Not: Language Models Pretend to Forget via In-Context Knowledge Unlearning

ACL 2025finding

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information to authorized internal users, such as employees or trusted p…

Cited by 0SourcePDFScholar
2025

DreamPRM: Domain-reweighted Process Reward Model for Multimodal Reasoning

NeurIPS 2025poster

Reasoning has substantially improved the performance of large language models (LLMs) on complicated tasks. Central to the current reasoning studies, Process Reward Models (PRMs) offer a fine-grained evaluation of intermediate reasoning steps and guide the reasoning process. However, extending PRMs t…

Cited by 0SourceScholar
2025

Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning

EMNLP 2025

Instruction-fine-tuned large language models (LLMs) under 14B parameters continue to underperform on natural language understanding (NLU) tasks, often trailing smaller models like BERT-base on benchmarks such as GLUE and SuperGLUE. Motivated by the success of reinforcement learning in reasoning task

2025

Low-Entropy Watermark Detection via Bayes’ Rule Derived Detector

ACL 2025finding

Text watermarking, which modify tokens to embed watermark, has proven effective in detecting machine-generated texts. Yet its application to low-entropy texts like code and mathematics presents significant challenges. A fair number of tokens in these texts are hardly modifiable without changing the…

2025

The Mirage of Model Editing: Revisiting Evaluation in the Wild

ACL 2025long

Despite near-perfect results reported in the literature, the effectiveness of model editing in real-world applications remains unclear. To bridge this gap, we introduce QAEdit, a new benchmark aligned with widely used question answering (QA) datasets, and WILD, a task-agnostic evaluation framework d…

2025

Too Consistent to Detect: A Study of Self-Consistent Errors in LLMs

EMNLP 2025

As large language models (LLMs) often generate plausible but incorrect content, error detection has become increasingly critical to ensure truthfulness.However, existing detection methods often overlook a critical problem we term as **self-consistent error**, where LLMs repeatedly generate the same

2024

Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?

ACL 2024long

While auxiliary information has become a key to enhancing Large Language Models (LLMs), relatively little is known about how LLMs merge these contexts, specifically contexts generated by LLMs and those retrieved from external sources.To investigate this, we formulate a systematic framework to identi…

2024

PKAD: Pretrained Knowledge is All You Need to Detect and Mitigate Textual Backdoor Attacks

EMNLP 2024finding

In textual backdoor attacks, attackers insert poisoned samples with triggered inputs and target labels into training datasets to manipulate model behavior, threatening the model’s security and reliability. Current defense methods can generally be categorized into inference-time and training-time one…

2024

Understanding and Improving Adversarial Collaborative Filtering for Robust Recommendation

NeurIPS 2024poster

Adversarial Collaborative Filtering (ACF), which typically applies adversarial perturbations at user and item embeddings through adversarial training, is widely recognized as an effective strategy for enhancing the robustness of Collaborative Filtering (CF) recommender systems against poisoning atta…

2024

When to Trust LLMs: Aligning Confidence with Response Quality

ACL 2024findings

Despite the success of large language models (LLMs) in natural language generation, much evidence shows that LLMs may produce incorrect or nonsensical text. This limitation highlights the importance of discerning when to trust LLMs, especially in safety-critical domains. Existing methods often expre…

2024

Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?

EMNLP 2024main

Recent large language models (LLMs) have demonstrated remarkable generalization abilities in mathematics and logical reasoning tasks.Prior research indicates that LLMs pre-trained with programming language data exhibit high mathematical and reasoning abilities; however, this causal relationship has…

2023

Augmentation-Aware Self-Supervision for Data-Efficient GAN Training

NeurIPS 2023poster

Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs. However, the augmentation implicitly introduces undesired invari…

2023

Unnatural Error Correction: GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text

EMNLP 2023short main

While Large Language Models (LLMs) have achieved remarkable performance in many tasks, much about their inner workings remains unclear. In this study, we present novel experimental insights into the resilience of LLMs, particularly GPT-4, when subjected to extensive character-level permutations. To…

Cited by 0SourcecodeScholar
2022

Conditional GANs with Auxiliary Discriminative Classifier

ICML 2022spotlight

Conditional generative models aim to learn the underlying joint distribution of data and labels to achieve conditional data generation. Among them, the auxiliary classifier generative adversarial network (AC-GAN) has been widely used, but suffers from the problem of low intra-class diversity of the…

2021

Hierarchical Network Based on the Fusion of Static and Dynamic Features for Speech Emotion Recognition

ICASSP 2021accepted

Many studies on automatic speech emotion recognition (SER) have been devoted to extracting meaningful emotional features for generating emotion-relevant representations. However, they generally ignore the complementary learning of static and dynamic features, leading to limited performances. In this…

Cited by 0SourceScholar
2021

Towards Consumer Loan Fraud Detection: Graph Neural Networks with Role-Constrained Conditional Random Field

AAAI 2021technical

Consumer loans, i.e., loans to finance consumers to buy certain types of expenditures, is increasingly popular in e-commerce platform. Different from traditional loans with mortgage, online consumer loans only take personal credit as collateral for loans. Consequently, loan fraud detection is partic…

Cited by 88SourcePDFScholar