← Search

shuai zhao

27 accepted papers

2026

DUP: Detection-guided Unlearning for Backdoor Purification in Language Models

AAAI 2026technical

As backdoor attacks become more stealthy and robust, they reveal critical weaknesses in current defense strategies: detection methods often rely on coarse-grained feature statistics, and purification methods typically require full retraining or additional clean models. To address these challenges, w

Cited by 0SourcePDFScholar
2026

From Stimuli to Minds: Enhancing Psychological Reasoning in LLMs via Bilateral Reinforcement Learning

AAAI 2026technical

Large Language Models show promise in emotion understanding, social reasoning, and empathy, yet struggle with psychologically grounded tasks requiring inference of implicit mental states in complex, socially and contextually ambiguous settings. These limitations stem from lacking theory-aligned supe

Cited by 0SourcePDFScholar
2026

LoC-Decomp: LLM Autoformalization via Logical Concept Decomposition and Iterative Feedback Correction

ICLR 2026poster

Autoformalization—the process of converting natural language mathematical statements into machine-verifiable formal code—plays a critical role in ensuring the reliability of mathematical reasoning generated by large language models (LLMs). Recent studies show that LLMs exhibit strong potential in au…

Cited by 0SourcecodeScholar
2026

Physics-Informed Autonomous LLM Agents for Explainable Power Electronics Modulation Design

AAAI 2026technical

LLM-based autonomous agents have recently shown strong capabilities in solving complex industrial design tasks. However, in domains aiming for carbon neutrality and high-performance renewable energy systems, current AI-assisted design automation methods face critical challenges in explainability, sc

Cited by 0SourcePDFScholar
2026

UAV$^2$: A Unified and Adaptive Scheduling Framework for UAV Autopilot System with Reinforcement Learning

ICML 2026poster

Unmanned aerial vehicle (UAV) autopilot systems typically comprise navigation and flight-control modules, and their effective scheduling is critical to achieving high flight performance. However, most existing UAV platforms adopt a split architecture in which navigation and flight control are deploy…

Cited by 0SourceScholar
2025

AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge

ACL 2025long

Data contamination hinders fair LLM evaluation by introducing test data into newer models’ training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee contamination-free evaluation as the newly collected data may contain pre-…

2025

Enhancing Multimodal Entity Linking with Jaccard Distance-based Conditional Contrastive Learning and Contextual Visual Augmentation

NAACL 2025long

Previous research on multimodal entity linking (MEL) has primarily employed contrastive learning as the primary objective. However, using the rest of the batch as negative samples without careful consideration, these studies risk leveraging easy features and potentially overlook essential details th…

Cited by 2SourcePDFScholar
2025

T2ICount: Enhancing Cross-modal Understanding for Zero-Shot Counting

CVPR 2025highlight

Zero-shot object counting aims to count instances of arbitrary object categories specified by text descriptions. Existing methods typically rely on vision-language models like CLIP, but often exhibit limited sensitivity to text prompts. We present T2ICount, a diffusion-based framework that leverages…

2025

Uni-Retrieval: A Multi-Style Retrieval Framework for STEM’s Education

ACL 2025long

In AI-facilitated teaching, leveraging various query styles to interpret abstract text descriptions is crucial for ensuring high-quality teaching. However, current retrieval models primarily focus on natural text-image retrieval, making them insufficiently tailored to educational scenarios due to th…

Cited by 0SourcePDFScholar
2025

Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation

ACL 2025finding

Parameter-efficient fine-tuning (PEFT) can bridge the gap between large language models (LLMs) and downstream tasks. However, PEFT has been proven vulnerable to malicious attacks. Research indicates that poisoned LLMs, even after PEFT, retain the capability to activate internalized backdoors when in…

2024

A Du-Octree based Cross-Attention Model for LiDAR Geometry Compression

ICRA 2024poster

Point cloud compression is an essential technology for efficient storage and transmission of 3D data. Previous methods usually use hierarchical tree data structures for encoding the spatial sparseness of point clouds. However, the node context within the tree is not fully discovered since the featur…

Cited by 4SourceScholar
2024

An Efficient Position Reconfiguration Approach for Maximizing Lifetime of Fixed-wing Swarm Drones

IROS 2024

With the development and application of swarm drones, some researchers have tried to replicating the migration patterns of geese in drones swarm formation to extend their lifetime. However, the problem of performing appropriate position reconfiguration based on the battery energy still remains an un

Cited by 0SourceScholar
2024

Defending Against Weight-Poisoning Backdoor Attacks for Parameter-Efficient Fine-Tuning

NAACL 2024findings

Recently, various parameter-efficient fine-tuning (PEFT) strategies for application to language models have been proposed and successfully implemented. However, this raises the question of whether PEFT, which only updates a limited set of model parameters, constitutes security vulnerabilities when c…

2024

Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models

ICLR 2024poster

One fascinating aspect of pre-trained vision-language models (VLMs) learning under language supervision is their impressive zero-shot generalization capability. However, this ability is hindered by distribution shifts between the training and testing data. Previous test time adaptation (TTA) methods…

2024

Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning

EMNLP 2024main

In-context learning, a paradigm bridging the gap between pre-training and fine-tuning, has demonstrated high efficacy in several NLP tasks, especially in few-shot settings. Despite being widely applied, in-context learning is vulnerable to malicious attacks. In this work, we raise security concerns…

2023

Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

ICASSP 2023accepted

Fine-tuning is widely used as the default algorithm for transfer learning from pre-trained models. Parameter inefficiency can however arise when, during transfer learning, all the parameters of a large pre-trained model need to be updated for individual downstream tasks. As the number of parameters…

Cited by 0SourceScholar
2023

Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models

EMNLP 2023long main

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based learning is vulnerable to backdoor attacks. Textual backdoor atta…

Cited by 0SourceScholar
2022

Analyzing Modality Robustness in Multimodal Sentiment Analysis

NAACL 2022long

Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment Analysis (MSA) models. In this work, we hope to address that by (i) Proposing simple d…

2022

Generative Prompt Tuning for Relation Classification

EMNLP 2022finding

Using prompts to explore the knowledge contained within pre-trained language models for downstream tasks has now become an active topic. Current prompt tuning methods mostly convert the downstream tasks to masked language modeling problems by adding cloze-style phrases and mapping all labels to verb…

2022

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression

AAAI 2022technical

Bounding box regression is an important component in object detection. Recent work achieves promising performance by optimizing the Intersection over Union (IoU). However, IoU-based loss has the gradient vanish problem in the case of low overlapping bounding boxes, and the model could easily ignore…

2021

Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework

ICML 2021spotlight

Most neural network pruning methods, such as filter-level and layer-level prunings, prune the network model along one dimension (depth, width, or resolution) solely to meet a computational budget. However, such a pruning policy often leads to excessive reduction of that dimension, thus inducing a hu…

Cited by 77SourcePDFScholar
2021

FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

EMNLP 2021finding

Despite the success of neural dialogue systems in achieving high performance on the leader-board, they cannot meet users’ requirements in practice, due to their poor reasoning skills. The underlying reason is that most neural dialogue models only capture the syntactic and semantic information, but f…

2021

Integrating Subgraph-Aware Relation and Direction Reasoning for Question Answering

ICASSP 2021accepted

Question Answering (QA) models over Knowledge Bases (KBs) are capable of providing more precise answers by utilizing relation information among entities. Although effective, most of these models solely rely on fixed relation representations to obtain answers for different question-related KB subgrap…

Cited by 0SourceScholar
2020

Modelling Long-distance Node Relations for KBQA with Global Dynamic Graph

COLING 2020main

The structural information of Knowledge Bases (KBs) has proven effective to Question Answering (QA). Previous studies rely on deep graph neural networks (GNNs) to capture rich structural information, which may not model node relations in particularly long distance due to oversmoothing issue. To addr…

Cited by 13SourcePDFScholar