← Search

Yao Qiang

6 accepted papers

2026

Not All Tokens Are Meant to Be Forgotten

AAAI 2026technical

Large Language Models (LLMs), pre-trained on massive text corpora, exhibit remarkable human-level language understanding, reasoning, and decision-making abilities. However, they tend to memorize unwanted information, such as private or copyrighted content, raising significant privacy and legal conce

Cited by 0SourcePDFScholar
2024

Fairness-aware Vision Transformer via Debiased Self-Attention

ECCV 2024poster

"Vision Transformer (ViT) has recently gained significant attention in solving computer vision (CV) problems due to its capability of extracting informative features and modeling long-range dependencies through the attention mechanism. Whereas recent works have explored the trustworthiness of ViT, i…

2023

Learning Compact Features via In-Training Representation Alignment

AAAI 2023technical

Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of the feature extractor (i.e., last hidden layer) and a linear classifier (i.e., output layer) that are trained jointly with stochastic gradient descent (SGD) on the loss function (e.g., cross-entropy). In each epoch, t…

Cited by 6SourcePDFScholar
2023

Negative Flux Aggregation to Estimate Feature Attributions

IJCAI 2023poster

There are increasing demands for understanding deep neural networks' (DNNs) behavior spurred by growing security and/or transparency concerns. Due to multi-layer nonlinearity of the deep neural network architectures, explaining DNN predictions still remains as an open problem, preventing us from gai…

2022

AttCAT: Explaining Transformers via Attentive Class Activation Tokens

NeurIPS 2022accept

Transformers have improved the state-of-the-art in various natural language processing and computer vision tasks. However, the success of the Transformer model has not yet been duly explained. Current explanation techniques, which dissect either the self-attention mechanism or gradient-based attribu…

2022

Counterfactual Interpolation Augmentation (CIA): A Unified Approach to Enhance Fairness and Explainability of DNN

IJCAI 2022poster

Bias in the training data can jeopardize fairness and explainability of deep neural network prediction on test data. We propose a novel bias-tailored data augmentation approach, Counterfactual Interpolation Augmentation (CIA), attempting to debias the training data by d-separating the spurious corre…