← Search

Ke Xu

114 accepted papers

2026

AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models

ICLR 2026poster

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex problem-solving through Chain-of-Thought (CoT) reasoning. However, the multi-step nature of CoT introduces new safety challenges that extend beyond conventional language model alignment. We identify a failure mode in…

Cited by 0SourceScholar
2026

Closing the Safety Gap: Surgical Concept Erasure in Visual Autoregressive Models

ICLR 2026poster

The rapid progress of visual autoregressive (VAR) models has brought new opportunities for text-to-image generation, but also heightened safety concerns. Existing concept erasure techniques, primarily designed for diffusion models, fail to generalize to VARs due to their next-scale token prediction…

Cited by 0SourcecodeScholar
2026

CoGeoAD: Hierarchical Color-Geometric Fusion with Multi-View Attention for Zero-Shot 3D Anomaly Detection

ICML 2026poster

Zero-shot 3D anomaly detection is essential for industrial quality inspection, where labeled anomaly samples are scarce. Meanwhile, existing methods lack an effective mechanism to fuse complementary 2D color images with 3D geometric structures, limiting their ability to detect both surface and struc…

Cited by 0SourceScholar
2026

DeFT-LoRA: Decoupled and Fused Tuning with LoRA Experts for Universal Cross-Domain Retrieval

AAAI 2026technical

Universal Cross-Domain Retrieval (UCDR) aims to retrieve images across unseen domains and categories, a critical capability for real-world applications. While large-scale Vision-Language Models (VLMs) like CLIP offer strong zero-shot category generalization, they struggle with domain shifts. Existin

Cited by 0SourcePDFScholar
2026

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

ICML 2026poster

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and their smaller counterparts, with the goal of replicating the re…

Cited by 0SourceScholar
2026

Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks

ICML 2026poster

The deployment of quantized neural networks on edge devices, combined with privacy regulations like GDPR, creates an urgent need for machine unlearning in quantized models. However, existing methods face critical challenges: they induce forgetting by training models to memorize incorrect labels, con…

Cited by 0SourceScholar
2026

GenSplat: Bridging the Generalization Gap in 3DGS Language Comprehension

CVPR 2026

In this paper, we propose GenSplat, a novel approach for language comprehension in 3D Gaussian Splatting (3DGS). Unlike previous methods that either achieve cross-scene generalization by being bounded to a predefined vocabulary or handle free-form language by overfitting to individual scenes, GenSpl

Cited by 0SourcecodeScholar
2026

Graph Out-of-Distribution Detection via Test-Time Calibration with Dual Dynamic Dictionaries

AAAI 2026technical

A key challenge in graph out-of-distribution (OOD) detection lies in the absence of ground-truth OOD samples during training. Existing methods are typically optimized to capture features within the in-distribution (ID) data and calculate OOD scores, which often limits pre-trained models from represe

Cited by 0SourcePDFScholar
2026

Influence without Confounding: Causal Discovery from Temporal Data with Long-term Carry-over Effects

ICLR 2026poster

Learning causal structures from temporal data is fundamental to many practical tasks, such as physical laws discovery and root causes localization. Real-world systems often exhibit long-term carry-over effects, where the value of a variable at the current time can be influenced by distant past va…

Cited by 0SourceScholar
2026

Mixture of States: Routing Token-Level Dynamics for Multimodal Generation

CVPR 2026

We introduce MoS (Mixture of States), a novel fusion paradigm for multimodal diffusion models that merges modalities using flexible, state-based interactions. The core of MoS is a learnable, token-wise router that creates denoising timestep- and input-dependent interactions between modalities' hidde

Cited by 0SourcecodeScholar
2026

QuEPT: Quantized Elastic Precision Transformers with One-Shot Calibration for Multi-Bit Switching

AAAI 2026technical

Elastic precision quantization enables multi-bit deployment via a single optimization pass, fitting diverse quantization scenarios. Yet, the high storage and optimization costs associated with the Transformer architecture, research on elastic quantization remains limited, particularly for large lang

Cited by 0SourcePDFScholar
2026

STD-Former: Image-Conditioned Texture Dictionary Encoding with Sparse Topological Supervision for Texture Recognition

ICML 2026poster

Texture recognition is often framed as matching an image to a static training-set dictionary or codebook. In practice, this assumption is brittle: label-preserving transformations (illumination, scale, compression, blur) can shift test features away from the fixed training dictionary, producing a tr…

Cited by 0SourceScholar
2026

SafeSearch: Automated Red-Teaming of LLM-Based Search Agents

ICML 2026poster

Search agents connect LLMs to the Internet, enabling them to access broader and more up-to-date information. However, this also introduces a new threat surface: unreliable search results can mislead agents into producing unsafe outputs. Real-world incidents and our two in-the-wild observations show …

Cited by 0SourceScholar
2026

Test-Time Poisoned Sample Detection by Exploiting Shallow Malicious Matching in Backdoored CLIP

ICLR 2026poster

CLIP, known for its strong semantic matching capabilities derived from large-scale pretraining, has been shown to be vulnerable to backdoor attacks in prior work. In this work, we find that such attacks leave a detectable trace. This trace manifests as a divergence in how image features align with t…

Cited by 0SourceScholar
2026

TurboGS: Accelerating 3D Gaussian Splatting via Error-Guided Sparse Pixel Sampling and Optimization

ICML 2026poster

Consumer-level applications require fast optimization of 3D Gaussian Splatting (3DGS) with high-fidelity novel view rendering. However, existing 3DGS acceleration approaches still incur substantial computation on redundant pixels while sacrificing fine details. In this paper, we present TurboGS, an …

Cited by 0SourceScholar
2026

Video Mirror Detection with the Motion-in-Depth Cue

AAAI 2026technical

Detecting mirror regions in RGB videos is essential for scene understanding in applications such as scene reconstruction and robotic navigation. Existing video mirror detectors typically rely on cues like inside-outside mirror correspondences and 2D motion inconsistencies. However, these methods oft

Cited by 0SourcePDFScholar
2026

Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach

AAAI 2026technical

Recent advances in vision-language models have opened up new possibilities for reasoning-driven image geolocalization. However, existing approaches often rely on synthetic reasoning annotations or external image retrieval, which can limit interpretability and generalizability. In this paper, we pres

Cited by 0SourcePDFScholar
2026

VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision Transformer

CVPR 2026

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt sets for normal and abnormal semantics, then compute image-t

Cited by 0SourcecodeScholar
2025

ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio–Language Models

NeurIPS 2025poster

Recent advances in Audio-Language Models (ALMs) have significantly improved multimodal understanding capabilities. However, the introduction of the audio modality also brings new and unique vulnerability vectors. Previous studies have proposed jailbreak attacks that specifically target ALMs, reveali…

Cited by 0SourcecodeScholar
2025

An Engorgio Prompt Makes Large Language Model Babble on

ICLR 2025poster

Auto-regressive large language models (LLMs) have yielded impressive performance in many real-world tasks. However, the new paradigm of these LLMs also exposes novel threats. In this paper, we explore their vulnerability to inference cost attacks, where a malicious user crafts Engorgio prompts to…

2025

Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models

ACL 2025long

Large Audio-Language Models (LALMs), such as GPT-4o, have recently unlocked audio dialogue capabilities, enabling direct spoken exchanges with humans. The potential of LALMs broadens their applicability across a wide range of practical scenarios supported by audio dialogues. However, given these adv…

2025

Efficient 3D Perception on Multi-Sweep Point Cloud with Gumbel Spatial Pruning

ICRA 2025

This paper studies point cloud perception within outdoor environments. Existing methods face limitations in recognizing objects located at a distance or occluded, due to the sparse nature of outdoor point clouds. In this work, we observe a significant mitigation of this problem by accumulating multi

Cited by 1SourceScholar
2025

Exploring Semantic-constrained Adversarial Example with Instruction Uncertainty Reduction

NeurIPS 2025poster

Recently, semantically constrained adversarial examples (SemanticAE), which are directly generated from natural language instructions, have become a promising avenue for future research due to their flexible attacking forms, but have not been thoroughly explored yet. To generate SemanticAEs, current…

Cited by 0SourceScholar
2025

FacLens: Transferable Probe for Foreseeing Non-Factuality in Fact-Seeking Question Answering of Large Language Models

EMNLP 2025

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction (NFP), predicting whether an LLM will generate a non-factual re

2025

FlowRefiner: A Robust Traffic Classification Framework against Label Noise

NeurIPS 2025poster

Network traffic classification is essential for network management and security. In recent years, deep learning (DL) algorithms have emerged as essential tools for classifying complex traffic. However, they rely heavily on high-quality labeled training data. In practice, traffic data is often noisy…

Cited by 0SourcecodeScholar
2025

ImageFlowNet: Forecasting Multiscale Image-Level Trajectories of Disease Progression with Irregularly-Sampled Longitudinal Medical Images

ICASSP 2025accepted

Advances in medical imaging technologies have enabled the collection of longitudinal images, which involve repeated scanning of the same patients over time, to monitor disease progression. However, predictive modeling of such data remains challenging due to high dimensionality, irregular sampling, a…

Cited by 0SourceScholar
2025

Language-Guided Salient Object Ranking

CVPR 2025poster

Salient Object Ranking (SOR) aims to study human attention shifts across different objects in the scene. It is a challenging task, as it requires comprehension of the relations among the salient objects in the scene. However, existing works often overlook such relations or model them implicitly. In…

Cited by 0SourcePDFScholar
2025

MIO: A Foundation Model on Multimodal Tokens

EMNLP 2025

In this paper, we introduce MIO, a novel foundation model built on multimodal tokens, capable of understanding and generating speech, text, images, and videos in an end-to-end, autoregressive manner. While the emergence of large language models (LLMs) and multimodal large language models (MM-LLMs) p

2025

MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations

NeurIPS 2025poster

Humans rely on multisensory integration to perceive spatial environments, where auditory cues enable sound source localization in three-dimensional space. Despite the critical role of spatial audio in immersive technologies such as VR/AR, most existing multimodal datasets provide only monaural audi…

Cited by 0SourcecodeScholar
2025

One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models

ICCV 2025poster

Vision-Language Pre-training (VLP) models have exhibited unprecedented capability in many applications by taking full advantage of the learned multimodal alignment. However, previous studies have shown they are vulnerable to maliciously crafted adversarial samples. Despite recent success, these atta…

2025

PopAlign: Diversifying Contrasting Patterns for a More Comprehensive Alignment

ACL 2025long

Alignment of large language models (LLMs) involves training models on preference-contrastive output pairs to adjust their responses according to human preferences. To obtain such contrastive pairs, traditional methods like RLHF and RLAIF rely on limited contrasting patterns, such as varying model va…

2025

RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation

ICLR 2025poster

Bimanual manipulation is essential in robotics, yet developing foundation models is extremely challenging due to the inherent complexity of coordinating two robot arms (leading to multi-modal action distributions) and the scarcity of training data. In this paper, we present the Robotics Diffusion Tr…

2025

Redundancy-Aware Test-Time Graph Out-of-Distribution Detection

NeurIPS 2025poster

Distributional discrepancy between training and test data can lead models to make inaccurate predictions when encountering out-of-distribution (OOD) samples in real-world applications. Although existing graph OOD detection methods leverage data-centric techniques to extract effective representations…

Cited by 0SourceScholar
2025

Rumor Detection on Social Media with Temporal Propagation Structure Optimization

COLING 2025main

Traditional methods for detecting rumors on social media primarily focus on analyzing textual content, often struggling to capture the complexity of online interactions. Recent research has shifted towards leveraging graph neural networks to model the hierarchical conversation structure that emerges…

Cited by 0SourcePDFScholar
2025

SEHDR: Single-Exposure HDR Novel View Synthesis via 3D Gaussian Bracketing

ICCV 2025poster

This paper presents SeHDR, a novel high dynamic range 3D Gaussian Splatting (HDR-3DGS) approach for generating HDR novel views given multi-view LDR images. Unlike existing methods that typically require the multi-view LDR input images to be captured from different exposures, which are tedious to cap…

2025

Soft Reasoning Paths for Knowledge Graph Completion

IJCAI 2025

Reasoning paths are reliable information in knowledge graph completion (KGC) in which algorithms can find strong clues of the actual relation between entities. However, in real-world applications, it is difficult to guarantee that computationally affordable paths exist toward all candidate entities.

2025

Speculating LLMs’ Chinese Training Data Pollution from Their Tokens

EMNLP 2025

Tokens are basic elements in the datasets for LLM training. It is well-known that many tokens representing Chinese phrases in the vocabulary of GPT (4o/4o-mini/o1/o3/4.5/4.1/o4-mini) are indicating contents like pornography or online gambling. Based on this observation, our goal is to locate Pollute

2025

Structural Entropy Guided Unsupervised Graph Out-Of-Distribution Detection

AAAI 2025technical

With the emerging of huge amount of unlabeled data, unsupervised out-of-distribution (OOD) detection is vital for ensuring the reliability of graph neural networks (GNNs) by identifying OOD samples from in-distribution (ID) ones during testing, where encountering novel or unknown data is inevitable.…

2025

Thinking in Granularity: Dynamic Quantization for Image Super-Resolution by Intriguing Multi-Granularity Clues

AAAI 2025technical

Dynamic quantization has attracted rising attention in image super-resolution (SR) as it expands the potential of heavy SR models onto mobile devices while preserving competitive performance. Most current methods explore layer-to-bit configuration upon varying local regions, adaptively allocating th…

2025

TopNet: Transformer-Efficient Occupancy Prediction Network for Octree-Structured Point Cloud Geometry Compression

CVPR 2025poster

Efficient Point Cloud Geometry Compression (PCGC) with a lower bits per point (BPP) and higher peak signal-to-noise ratio (PSNR) is essential for the transportation of large-scale 3D data. Although octree-based entropy models can reduce BPP without introducing geometry distortion, existing CNN-based…

2025

Under the Shadow: Exploiting Opacity Variation for Fine-grained Shadow Detection

NeurIPS 2025poster

Shadow characteristics are of great importance for scene understanding. Existing works mainly consider shadow regions as binary masks, often leading to imprecise detection results and suboptimal performance for scene understanding. We demonstrate that such an assumption oversimplifies light-…

Cited by 0SourceScholar
2025

Understanding Large Language Model Vulnerabilities to Social Bias Attacks

ACL 2025long

Large Language Models (LLMs) have become foundational in human-computer interaction, demonstrating remarkable linguistic capabilities across various tasks. However, there is a growing concern about their potential to perpetuate social biases present in their training data. In this paper, we comprehe…

Cited by 0SourcePDFScholar
2025

Understanding the Dark Side of LLMs’ Intrinsic Self-Correction

ACL 2025long

Intrinsic self-correction was initially proposed to improve LLMs’ responses via feedback solely based on their inherent capability. However, recent works show that LLMs’ intrinsic self-correction fails without oracle labels as feedback. In this paper, our research goal is to *interpret LLMs’ intrins…

Cited by 0SourcePDFScholar
2025

“I’ve Decided to Leak”: Probing Internals Behind Prompt Leakage Intents

EMNLP 2025

Large language models (LLMs) exhibit prompt leakage vulnerabilities, where they may be coaxed into revealing system prompts embedded in LLM services, raising intellectual property and confidentiality concerns. An intriguing question arises: Do LLMs genuinely internalize prompt leakage intents in the

2024

"Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Prompts"

ECCV 2024poster

"This paper proposes an algorithm for automatically labeling 3D objects from 2D point or box prompts, especially focusing on applications in autonomous driving. Unlike previous arts, our auto-labeler predicts 3D shapes instead of bounding boxes and does not require training on a specific dataset. We…

2024

ADVSV: An Over-the-Air Adversarial Attack Dataset for Speaker Verification

ICASSP 2024accepted

It is known that deep neural networks are vulnerable to adversarial attacks. Although Automatic Speaker Verification (ASV) built on top of deep neural networks exhibits robust performance in controlled scenarios, many studies confirm that ASV is vulnerable to adversarial attacks. The lack of a stand…

Cited by 0SourceScholar
2024

Adversarial Robust Safeguard for Evading Deep Facial Manipulation

AAAI 2024technical

The non-consensual exploitation of facial manipulation has emerged as a pressing societal concern. In tandem with the identification of such fake content, recent research endeavors have advocated countering manipulation techniques through proactive interventions, specifically the incorporation of ad…

Cited by 3SourcePDFScholar
2024

Boosting Neural Cognitive Diagnosis with Student’s Affective State Modeling

AAAI 2024technical

Cognitive Diagnosis Modeling aims to infer students' proficiency level on knowledge concepts from their response logs. Existing methods typically model students’ response processes as the interaction between students and exercises or concepts based on hand-crafted or deeply-learned interaction funct…

2024

Color Shift Estimation-and-Correction for Image Enhancement

CVPR 2024poster

Images captured under sub-optimal illumination conditions may contain both over- and under-exposures. We observe that over- and over-exposed regions display opposite color tone distribution shifts which may not be easily normalized in joint modeling as they usually do not have "normal-exposed" regio…

2024

Effective Video Mirror Detection with Inconsistent Motion Cues

CVPR 2024poster

Image-based mirror detection has recently undergone rapid research due to its significance in applications such as robotic navigation semantic segmentation and scene reconstruction. Recently VMD-Net was proposed as the first video mirror detection technique by modeling dual correspondences between t…

2024

Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods

IJCAI 2024poster

Topological consistency plays a crucial role in the task of boundary segmentation for reticular images, such as cell membrane segmentation in neuron electron microscopic images, grain boundary segmentation in material microscopic images and road segmentation in aerial images. In these fields, topolo…

2024

GRAPH-CONSTRAINED DIFFUSION FOR END-TO-END PATH PLANNING

ICLR 2024poster

Path planning underpins various applications such as transportation, logistics, and robotics. Conventionally, path planning is formulated with explicit optimization objectives such as distance or time. However, real-world data reveals that user intentions are hard-to-model, suggesting a need for dat…

Cited by 12SourcePDFScholar
2024

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification

NAACL 2024long

Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmentation rules to generate contrastive samples, which can potentially corrupt or dis…

2024

LTA-PCS: Learnable Task-Agnostic Point Cloud Sampling

CVPR 2024poster

Recently many approaches directly operate on point clouds for different tasks. These approaches become more computation and storage demanding when point cloud size is large. To reduce the required computation and storage one possible solution is to sample the point cloud. In this paper we propose th…

Cited by 5SourcePDFScholar
2024

Learning Spatio-Temporal Relations with Multi-Scale Integrated Perception for Video Anomaly Detection

ICASSP 2024accepted

In weakly supervised video anomaly detection, it has been verified that anomalies can be biased by background noise. Previous works attempted to focus on local regions to exclude irrelevant information. However, the abnormal events in different scenes vary in size, and current methods struggle to co…

Cited by 0SourceScholar
2024

Low-Light Raw Image Enhancement on a Dataset Suffering Light Effects

ICASSP 2024accepted

Deep learning-based methods have achieved remarkable success in low-light image enhancement (LLIE). But most existing works are based on sRGB data and do not focus on the light effects in bright regions when enhancing low-light regions. This inevitably leads to excessive enhancement and saturation o…

Cited by 0SourceScholar
2024

LuSh-NeRF: Lighting up and Sharpening NeRFs for Low-light Scenes

NeurIPS 2024poster

Neural Radiance Fields (NeRFs) have shown remarkable performances in producing novel-view images from high-quality scene images. However, hand-held low-light photography challenges NeRFs as the captured images may simultaneously suffer from low visibility, noise, and camera shakes. While existing Ne…

2024

Multi-View Dynamic Reflection Prior for Video Glass Surface Detection

AAAI 2024technical

Recent research has shown significant interest in image-based glass surface detection (GSD). However, detecting glass surfaces in dynamic scenes remains largely unexplored due to the lack of a high-quality dataset and an effective video glass surface detection (VGSD) method. In this paper, we propos…

2024

OWL: A Large Language Model for IT Operations

ICLR 2024poster

With the rapid advancement of IT operations, managing and analyzing large data volumes efficiently for practical applications has become increasingly critical. Natural Language Processing (NLP) techniques have demonstrated remarkable capabilities in various tasks, including named entity recognition,…

2024

PTMQ: Post-training Multi-Bit Quantization of Neural Networks

AAAI 2024technical

The ability of model quantization with arbitrary bit-width to dynamically meet diverse bit-width requirements during runtime has attracted significant attention. Recent research has focused on optimizing large-scale training methods to achieve robust bit-width adaptation, which is a time-consuming p…

2024

PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness

EMNLP 2024finding

Large Language Models (LLMs) demonstrate impressive capabilities across various domains, including role-playing, creative writing, mathematical reasoning, and coding. Despite these advancements, LLMs still encounter challenges with length control, frequently failing to adhere to specific length cons…

2024

Recasting Regional Lighting for Shadow Removal

AAAI 2024technical

Removing shadows requires an understanding of both lighting conditions and object textures in a scene. Existing methods typically learn pixel-level color mappings between shadow and non-shadow images, in which the joint modeling of lighting and object textures is implicit and inadequate. We observe…

2024

RoleAgent: Building, Interacting, and Benchmarking High-quality Role-Playing Agents from Scripts

NeurIPS 2024poster

Believable agents can empower interactive applications ranging from immersive environments to rehearsal spaces for interpersonal communication. Recently, generative agents have been proposed to simulate believable human behavior by using Large Language Models. However, the existing method heavily re…

Cited by 1SourcePDFScholar
2024

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

ACL 2024findings

The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters. However, the closed-source nature of state-of-the-art LLMs and their general-purpose training limit role-playing opt…

2024

Walking in Others’ Shoes: How Perspective-Taking Guides Large Language Models in Reducing Toxicity and Bias

EMNLP 2024main

The common toxicity and societal bias in contents generated by large language models (LLMs) necessitate strategies to reduce harm. Present solutions often demand white-box access to the model or substantial training, which is impractical for cutting-edge commercial LLMs. Moreover, prevailing prompti…

Cited by 10SourcePDFScholar
2023

Adaptive Contrastive Knowledge Distillation for BERT Compression

ACL 2023findings

In this paper, we propose a new knowledge distillation approach called adaptive contrastive knowledge distillation (ACKD) for BERT compression. Different from existing knowledge distillation methods for BERT that implicitly learn discriminative student features by mimicking the teacher features, we…

Cited by 10SourcePDFScholar
2023

Adaptive Illumination Mapping for Shadow Detection in Raw Images

ICCV 2023poster

Shadow detection methods rely on multi-scale contrast, especially global contrast, information to locate shadows correctly. However, we observe that the camera image signal processor (ISP) tends to preserve more local contrast information by sacrificing global contrast information during the raw-to-…

Cited by 15PDFcodeScholar
2023

Differentially Private Learning with Per-Sample Adaptive Clipping

AAAI 2023technical

Privacy in AI remains a topic that draws attention from researchers and the general public in recent years. As one way to implement privacy-preserving AI, differentially private learning is a framework that enables AI models to use differential privacy (DP). To achieve DP in the learning process, ex…

Cited by 18SourcePDFScholar
2023

HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text Classification

ACL 2023long

Hierarchical text classification (HTC) is a challenging subtask of multi-label classification as the labels form a complex hierarchical structure. Existing dual-encoder methods in HTC achieve weak performance gains with huge memory overheads and their structure encoders heavily rely on domain knowle…

2023

Multimodal Federated Learning via Contrastive Representation Ensemble

ICLR 2023poster

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a privacy-conscious alternative to centralized machine learning. However, e…

2023

Referring Image Segmentation Using Text Supervision

ICCV 2023poster

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to localize the target object. Hence, we propose a novel weakly-…

Cited by 34PDFcodeScholar
2023

SEGA: Structural Entropy Guided Anchor View for Graph Contrastive Learning

ICML 2023poster

In contrastive learning, the choice of "view" controls the information that the representation captures and influences the performance of the model. However, leading graph contrastive learning methods generally produce views via random corruption or learning, which could lead to the loss of essentia…

2023

SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-Time Performance on Mobile Device

ICCV 2023poster

With the rapid development of AI hardware accelerators, applying deep learning-based algorithms to solve various low-level vision tasks on mobile devices has gradually become possible. However, two main problems still need to be solved. Firstly, most low-level vision algorithms are task-specific and…

Cited by 5PDFcodeScholar
2023

Tracing the Origin of Adversarial Attack for Forensic Investigation and Deterrence

ICCV 2023poster

Deep neural networks are vulnerable to adversarial attacks. In this paper, we take the role of investigators who want to trace the attack and identify the source, that is, the particular model which the adversarial examples are generated from. Techniques derived would aid forensic investigation of a…

Cited by 5PDFcodeScholar
2022

A Simple yet Effective Method for Graph Classification

IJCAI 2022poster

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models. Intuitively, given a problem, a simpler data structure come…

2022

Bi-Directional Object-Context Prioritization Learning for Saliency Ranking

CVPR 2022poster

The saliency ranking task is recently proposed to study the visual behavior that humans would typically shift their attention over different objects of a scene based on their degrees of saliency. Existing approaches focus on learning either object-object or object-scene relations. Such a strategy fo…

Cited by 38PDFcodeScholar
2022

CoupleFace: Relation Matters for Face Recognition Distillation

ECCV 2022poster

"Knowledge distillation is an effective method to im- prove the performance of a lightweight neural network (i.e., student model) by transferring the knowledge of a well- performed neural network (i.e., teacher model), which has been widely applied in many computer vision tasks, includ- ing face rec…

Cited by 24SourcePDFScholar
2022

Exploring Memorization in Adversarial Training

ICLR 2022poster

Deep learning models have a propensity for fitting the entire training set even with random labels, which requires memorization of every training sample. In this paper, we explore the memorization effect in adversarial training (AT) for promoting a deeper understanding of model capacity, convergence…

2022

Geometry-aware Two-scale PIFu Representation for Human Reconstruction

NeurIPS 2022accept

Although PIFu-based 3D human reconstruction methods are popular, the quality of recovered details is still unsatisfactory. In a sparse (e.g., 3 RGBD sensors) capture setting, the depth noise is typically amplified in the PIFu representation, resulting in flat facial surfaces and geometry-fallible bo…

Cited by 17SourcePDFScholar
2022

Harmonizer: Learning to Perform White-Box Image and Video Harmonization

ECCV 2022poster

"Recent works on image harmonization solve the problem as a pixel-wise image translation task via large autoencoders. They have unsatisfactory performances and slow inference speeds when dealing with high-resolution images. In this work, we observe that adjusting the input arguments of basic image f…

2022

Hierarchical Information Matters: Text Classification via Tree Based Graph Neural Network

COLING 2022main

Text classification is a primary task in natural language processing (NLP). Recently, graph neural networks (GNNs) have developed rapidly and been applied to text classification tasks. As a special kind of graph data, the tree has a simpler data structure and can provide rich hierarchical informatio…

Cited by 11SourcePDFScholar
2022

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-High Resolution Segmentation

CVPR 2022poster

The huge burden of computation and memory are two obstacles in ultra-high resolution image segmentation. To tackle these issues, most of the previous works follow the global-local refinement pipeline, which pays more attention to the memory consumption but neglects the inference speed. In comparison…

Cited by 60PDFcodeScholar
2022

MultiQuant: Training Once for Multi-bit Quantization of Neural Networks

IJCAI 2022poster

Quantization has become a popular technique to compress deep neural networks (DNNs) and reduce computational costs, but most prior work focuses on training DNNs at each individual fixed bit-width and accuracy trade-off point. How to produce a model with flexible precision is largely unexplored. This…

Cited by 9SourcePDFScholar
2022

Rethinking Efficient Lane Detection via Curve Modeling

CVPR 2022poster

This paper presents a novel parametric curve-based method for lane detection in RGB images. Unlike state-of-the-art segmentation-based and point detection-based methods that typically require heuristics to either decode predictions or formulate a large sum of anchors, the curve-based methods can lea…

Cited by 202PDFcodeScholar
2022

SatFormer: Saliency-Guided Abnormality-Aware Transformer for Retinal Disease Classification in Fundus Image

IJCAI 2022poster

Automatic and accurate retinal disease diagnosis is critical to guide proper therapy and prevent potential vision loss. Previous works simply exploit the most discriminative features while ignoring the pathological visual clues of scattered subtle lesions. Therefore, without a comprehensive understa…

Cited by 11SourcePDFScholar
2021

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression

EMNLP 2021main

Recent studies on compression of pretrained language models (e.g., BERT) usually use preserved accuracy as the metric for evaluation. In this paper, we propose two new metrics, label loyalty and probability loyalty that measure how closely a compressed model (i.e., student) mimics the original model…

2021

Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge

NAACL 2021long

Cant is important for understanding advertising, comedies and dog-whistle politics. However, computational research on cant is hindered by a lack of available datasets. In this paper, we propose a large and diverse Chinese dataset for creating and understanding cant from a computational linguistics…

2021

CoSQA: 20,000+ Web Queries for Code Search and Question Answering

ACL 2021long

Finding codes given natural language query is beneficial to the productivity of software developers. Future progress towards better semantic matching between query and code requires richer supervised training resources. To remedy this, we introduce CoSQA dataset. It includes 20,604 labels for pairs…

2021

Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting

EMNLP 2021main

In this paper, we propose Sequence Span Rewriting (SSR), a self-supervised task for sequence-to-sequence (Seq2Seq) pre-training. SSR learns to refine the machine-generated imperfect text spans into ground truth text. SSR provides more fine-grained and informative supervision in addition to the origi…

2021

Location-Aware Single Image Reflection Removal

ICCV 2021poster

This paper proposes a novel location-aware deep-learning-based single image reflection removal method. Our network has a reflection detection module to regress a probabilistic reflection confidence map, taking multi-scale Laplacian features as inputs. This probabilistic map tells if a region is refl…

Cited by 110PDFcodeScholar
2021

Mitigating Intensity Bias in Shadow Detection via Feature Decomposition and Reweighting

ICCV 2021poster

While CNNs achieved remarkable progress in shadow detection, they tend to make mistakes in dark non-shadow regions and relatively bright shadow regions. They are also susceptible to brightness change. These two phenomenons reveal that deep shadow detectors heavily depend on the intensity cue, which…

Cited by 78PDFScholar
2021

Self-Attention Attribution: Interpreting Information Interactions Inside Transformer

AAAI 2021technical

The great success of Transformer-based models benefits from the powerful multi-head self-attention mechanism, which learns token dependencies and encodes contextual information from the input. Prior work strives to attribute model decisions to individual input features with different saliency measur…

2020

BERT Loses Patience: Fast and Robust Inference with Early Exit

NeurIPS 2020poster

In this paper, we propose Patience-based Early Exit, a straightforward yet effective inference method that can be used as a plug-and-play technique to simultaneously improve the efficiency and robustness of a pretrained language model (PLM). To achieve this, our approach couples an internal-classifi…

2020

Electronics-Free Logic Circuits for Localized Feedback Control of Multi-Actuator Soft Robots

RA-L 2020

The vision of creating entirely-soft robots capable of performing complex tasks will be accomplished only when the controllers required for autonomous operation can be fully implemented using soft components. Despite recent advances in compliant fluidic circuitry for mechanical signal processing, th

Cited by 11SourceScholar
2020

Relation-Aware Transformer for Portfolio Policy Learning

IJCAI 2020poster

Portfolio selection is an important yet challenging task in AI for FinTech. One of the key issues is how to represent the non-stationary price series of assets in a portfolio, which is important for portfolio decisions. The existing methods, however, fall short of capturing: 1) the complicated seq…

2020

Self-Adversarial Learning with Comparative Discrimination for Text Generation

ICLR 2020poster

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel self-adversarial learning (SAL) paradigm for improving GANs' performa…

Cited by 31SourceScholar
2019

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

CVPR 2019poster

Removing rain streaks from a single image has been drawing considerable attention as rain streaks can severely degrade the image quality and affect the performance of existing outdoor vision tasks. While recent CNN-based derainers have reported promising performances, deraining remains an open probl…

Cited by 698PDFScholar
2018

Image Correction via Deep Reciprocating HDR Transformation

CVPR 2018poster

Image correction aims to adjust an input image into a visually pleasing one with the detail in the under/over exposed regions recovered. However, existing image correction methods are mainly based on image pixel operations, and attempting to recover the lost detail from these under/over exposed regi…

Cited by 142SourcePDFScholar