← Search

Kai Li

113 accepted papers

2026

A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation

ICML 2026poster

Query-based universal sound separation is fundamental to intelligent auditory systems, aiming to isolate specific sources from mixtures. Despite recent advances, existing methods continue to suffer from residual interference in complex acoustic scenes. This performance limitation stems largely from …

Cited by 0SourcecodeScholar
2026

AudioTrust: Benchmarking The Multifaceted Trustworthiness of Audio Large Language Models

ICLR 2026poster

The rapid development and widespread adoption of Audio Large Language Models (ALLMs) require a rigorous assessment of their trustworthiness. However, existing evaluation frameworks, primarily designed for text, are not equipped to handle the unique vulnerabilities introduced by audio’s acoustic prop…

Cited by 0SourcecodeScholar
2026

BREAKING DATA EFFICIENCY DILEMMA: A FEDERATED AND AUGMENTED LEARNING FRAMEWORK FOR ALZHEIMER’S DISEASE DETECTION VIA SPEECH

ICASSP 2026poster

Early diagnosis of Alzheimer's Disease (AD) is crucial for delaying its progression. While AI-based speech detection is non-invasive and cost-effective, it faces a critical data efficiency dilemma due to medical data scarcity and privacy barriers. Therefore, we propose FAL-AD, a novel framework that…

Cited by 0SourcePDFScholar
2026

Benchmarking the Limits of In-Context Reinforcement Learning for Ad-Hoc Teamwork

ICML 2026poster

In-Context Reinforcement Learning (ICRL) has enabled foundation agents to adapt instantaneously to novel tasks, yet its efficacy in Ad-Hoc Teamwork (AHT)—where coordination with unknown partners is required—remains unexplored. To rigorously evaluate this, we introduce a large-scale benchmark **ICRL4…

Cited by 0SourceScholar
2026

Bringing Code ALIVE: Optimizing Interactive Frontend Mini-Games via Automated Play and Reinforcement Learning at Scale

ICML 2026poster

The rapid evolution of Large Language Models (LLMs) has empowered even non-programmers to create visually appealing frontend mini-games with a single instruction. However, open-source models significantly lag behind proprietary counterparts in this domain. The core bottleneck is the lack of an evalu…

Cited by 0SourceScholar
2026

DGS: Dual Gradient and Semantic-Shift Guided Low-Rank Adaptation for Class Incremental Learning

CVPR 2026

In Class-Incremental Learning (CIL), parameter efficient fine-tuning applied to Pre-trained Models (PTMs) remain vulnerable to catastrophic forgetting as they adapt to new tasks. The prevalent strategy to mitigate catastrophic forgetting is to constrain gradients within the orthogonal subspaces of p

Cited by 0SourceScholar
2026

Decision-Driven Orthogonal Learning with Complementary Feature Mining for Robust Synthetic Image Detection

AAAI 2026technical

The widespread and inconsistent compression applied by Online Social Networks severely degrades the performance of synthetic image detectors. We attribute this degradation to two main issues: 1) the model confuses forgery artifacts with compression artifacts, and 2) compression erodes crucial discri

Cited by 0SourcePDFScholar
2026

Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy

ICML 2026poster

Diffusion models have recently set new benchmarks in Speech Enhancement (SE). However, most existing score-based models treat speech spectrograms merely as generic 2D images, applying uniform processing that ignores the intrinsic structural sparsity of audio, which results in inefficient spectral re…

Cited by 0SourceScholar
2026

EchoGen: Generating Visual Echoes in Any Scene via Feed-Forward Subject-Driven Auto-Regressive Model

ICLR 2026poster

Subject-driven generation is a critical task in creative AI; yet current state-of-the-art methods present a stark trade-off. They either rely on computationally expensive, per-subject fine-tuning, sacrificing efficiency and zero-shot capability, or employ feed-forward architectures built on diffusio…

Cited by 0SourcecodeScholar
2026

Efficient Audio-Visual Speech Separation with Discrete Lip Semantics and Multi-Scale Global-Local Attention

ICLR 2026poster

Audio-visual speech separation (AVSS) methods leverage visual cues to extract target speech and have demonstrated strong separation quality in noisy acoustic environments. However, these methods usually involve a large number of parameters and require high computational cost, which is unacceptable i…

Cited by 0SourcecodeScholar
2026

Enhancing Vision-Based Policies with Omni-View and Cross-Modality Knowledge Distillation for Mobile Robots

ICRA 2026poster

Vision-based policies are widely applied in robotics for tasks such as manipulation and locomotion. On lightweight mobile robots, however, they face a trilemma of limited scene transferability, restricted onboard computation resources, and sensor hardware cost. To address these issues, we propose a …

2026

FGNet: Leveraging Feature-Guided Attention to Refine SAM2 for 3D EM Neuron Segmentation

AAAI 2026technical

Accurate segmentation of neural structures in Electron Microscopy (EM) images is paramount for neuroscience. However, this task is challenged by intricate morphologies, low signal-to-noise ratios, and scarce annotations, limiting the accuracy and generalization of existing methods. To address these

Cited by 0SourcePDFScholar
2026

Human-like Abstract Visual Reasoning via Understanding and Solving Reasoning Loop

CVPR 2026

Abstract visual reasoning benchmarks such as ARC-AGI evaluate the ability to infer generalizable transformation rules from few graphical demonstrations, a capability where current deep learning models severely underperform. Mainstream LLMs achieve only 15.8% (DeepSeek-R1) and 34.5% (o3-mini-high) ac

Cited by 0SourceScholar
2026

HyMTRL: A Hybrid Multi-Task Reinforcement Learning Framework via Phased Policy Evolution

ICML 2026poster

Multi-task reinforcement learning (MTRL) aims to improve sample efficiency by sharing knowledge across related tasks, but it often suffers from asynchronous learning progress caused by inherent differences in task difficulty. This imbalance places substantial representational strain on the shared cr…

Cited by 0SourceScholar
2026

K²-Agent: Co-Evolving Know-What and Know-How for Hierarchical Mobile Device Control

ICLR 2026poster

Existing mobile device control agents often perform poorly when solving complex tasks requiring long-horizon planning and precise operations, typically due to a lack of relevant task experience or unfamiliarity with skill execution. We propose $\textbf{K²-Agent}$, a hierarchical framework that model…

Cited by 0SourcecodeScholar
2026

Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining

CVPR 2026

High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it struggles to generalize to real-world data due to limited scale and

Cited by 0SourcecodeScholar
2026

SCOPE: Skeleton Graph-Based Computation-Efficient Framework for Autonomous UAV Exploration

RA-L 2026

Autonomous exploration in unknown environments is key for mobile robots, helping them perceive, map, and make decisions in complex areas. However, current methods often rely on frequent global optimization, suffering from high computational latency and trajectory oscillation, especially on resource-

Cited by 0SourceScholar
2026

SepPrune: Structured Pruning for Efficient Deep Speech Separation

AAAI 2026technical

Although deep learning has substantially advanced speech separation in recent years, most existing studies continue to prioritize separation quality while overlooking computational efficiency, an essential factor for low-latency speech processing in real-time applications. In this paper, we propose

Cited by 0SourcePDFScholar
2026

When AVSR Meets Video Conferencing: Dataset, Degradation, and the Hidden Mechanism Behind Performance Collapse

CVPR 2026

Audio-Visual Speech Recognition (AVSR) has achieved remarkable progress in offline conditions, yet its robustness in real-world video conferencing (VC) remains largely unexplored. This paper presents the first systematic evaluation of state-of-the-art AVSR models across mainstream VC platforms, reve

Cited by 0SourceScholar
2025

An Open-Ended Learning Framework for Opponent Modeling

AAAI 2025technical

Opponent Modeling (OM) aims to enhance decision-making by modeling other agents in multi-agent environments. Existing works typically learn opponent models against a pre-designated fixed set of opponents during training. However, this will cause poor generalization when facing unknown opponents duri…

Cited by 0SourcePDFScholar
2025

Critical Forgetting-Based Multi-Scale Disentanglement for Deepfake Detection

AAAI 2025technical

Recent face forgery detection methods based on disentangled representation learning utilize paired images for cross-reconstruction, aiming to extract forgery-relevant attributes and forgery-irrelevant content. However, there still exist the following issues that may comprise the detector performance…

Cited by 0SourcePDFScholar
2025

Diverse Policies Recovering via Pointwise Mutual Information Weighted Imitation Learning

ICLR 2025poster

Recovering a spectrum of diverse policies from a set of expert trajectories is an important research topic in imitation learning. After determining a latent style for a trajectory, previous diverse polices recovering methods usually employ a vanilla behavioral cloning learning objective conditioned…

Cited by 0SourcePDFScholar
2025

Dynamic Dictionary Learning for Remote Sensing Image Segmentation

ICCV 2025poster

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they often fail to dynamically adjust semantic embeddings according…

2025

Enhanced Equilibria-Solving via Private Information Pre-Branch Structure in Adversarial Team Games

UAI 2025

In ex ante coordinated adversarial team games (ATGs), a team competes against an adversary, and team members can only coordinate their strategies before the game starts. The team-maxmin equilibrium with correlation (TMECor) is a suitable solution concept for extensive-form sequential ATGs. One class

Cited by 0SourcePDFScholar
2025

FPEM: Face Prior Enhanced Facial Attractiveness Prediction for Live Videos with Face Retouching

ICCV 2025poster

Facial attractiveness prediction (FAP) has long been an important computer vision task, which could be widely applied in live videos with facial retouching. However, previous FAP datasets are either small or closed-source. Moreover, the corresponding FAP models exhibit limited generalization and ada…

2025

Goal-Oriented Skill Abstraction for Offline Multi-Task Reinforcement Learning

ICML 2025poster

Offline multi-task reinforcement learning aims to learn a unified policy capable of solving multiple tasks using only pre-collected task-mixed datasets, without requiring any online interaction with the environment. However, it faces significant challenges in effectively sharing knowledge across tas…

Cited by 0SourcePDFScholar
2025

Indoor Geomagnetic Matching Location Based on Iterative Local Search and Improved Particle Swarm Fusion

RA-L 2025

In the complex indoor environment, geomagnetic matching is an effective way to realize indoor positioning of mobile robots. Aiming at the problem that the application of Particle Swarm Optimization (PSO) algorithm leads to the decline of geomagnetic matching accuracy, stability and convergence speed

Cited by 5SourceScholar
2025

InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differences

ICLR 2025poster

Recent advances in Customized Concept Swapping (CCS) enable a text-to-image model to swap a concept in the source image with a customized target concept. However, the existing methods still face the challenges of $\textit{\textbf{inconsistency}}$ and $\textit{\textbf{inefficiency}}$. They struggle t…

2025

MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix

NeurIPS 2025poster

We introduce MMAR, a new benchmark designed to evaluate the deep reasoning capabilities of Audio-Language Models (ALMs) across massive multi-disciplinary tasks. MMAR comprises 1,000 meticulously curated audio-question-answer triplets, collected from real-world internet videos and refined through ite…

Cited by 0SourcecodeScholar
2025

MultiBooth: Towards Generating All Your Concepts in an Image from Text

AAAI 2025technical

This paper introduces MultiBooth, a method that generates images from texts containing various concepts from users.Despite diffusion models bringing significant advancements for customized text-to-image generation, existing methods often struggle with multi-concept scenarios due to low concept fidel…

2025

Offline Opponent Modeling with Truncated Q-driven Instant Policy Refinement

ICML 2025poster

Offline Opponent Modeling (OOM) aims to learn an adaptive autonomous agent policy that dynamically adapts to opponents using an offline dataset from multi-agent games. Previous work assumes that the dataset is optimal. However, this assumption is difficult to satisfy in the real world. When the data…

Cited by 0SourcePDFScholar
2025

RUN: Reversible Unfolding Network for Concealed Object Segmentation

ICML 2025poster

Concealed object segmentation (COS) is a challenging problem that focuses on identifying objects that are visually blended into their background. Existing methods often employ reversible strategies to concentrate on uncertain regions but only focus on the mask level, overlooking the valuable of the…

2025

Repurposing 2D Diffusion Models with Gaussian Atlas for 3D Generation

ICCV 2025poster

Text-to-image diffusion models have seen significant development recently due to increasing availability of paired 2D data. Although a similar trend is emerging in 3D generation, the limited availability of high-quality 3D data has resulted in less competitive 3D diffusion models compared to their 2…

Cited by 0SourcePDFScholar
2025

Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model

ICLR 2025spotlight

Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion-based models (DM) have shown promising performance but are often burdened by heavy computatio…

2025

SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal

ICLR 2025poster

Evaluating aligned large language models' (LLMs) ability to recognize and reject unsafe user requests is crucial for safe, policy-compliant deployments. Existing evaluation efforts, however, face three limitations that we address with **SORRY-Bench**, our proposed benchmark. **First**, existing meth…

2025

SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios

ICLR 2025poster

Systematic evaluation of speech separation and enhancement models under moving sound source conditions requires extensive and diverse data. However, real-world datasets often lack sufficient data for training and evaluation, and synthetic datasets, while larger, lack acoustic realism. Consequently,…

2025

TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation

ICLR 2025poster

In recent years, much speech separation research has focused primarily on improving model performance. However, for low-latency speech processing systems, high efficiency is equally important. Therefore, we propose a speech separation model with significantly reduced parameters and computational cos…

Cited by 0SourcePDFScholar
2024

BitDelta: Your Fine-Tune May Only Be Worth One Bit

NeurIPS 2024poster

Large Language Models (LLMs) are typically trained in two phases: pre-training on large internet-scale datasets, and fine-tuning for downstream tasks. Given the higher computational demand of pre-training, it is intuitive to assume that fine-tuning adds less new information to the model, and is thus…

2024

Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation

ICLR 2024spotlight

The rapid progress in open-source large language models (LLMs) is significantly advancing AI development. Extensive efforts have been made before model release to align their behavior with human values, with the primary goal of ensuring their helpfulness and harmlessness. However, even carefully ali…

2024

Cooperative Motion Mechanism of a Bionic Sailfish Robot With High Motion Performance

RA-L 2024

The sailfish possesses outstanding motion performance among marine species, while the robotic fish using the sailfish as a bionic object has received little attention. In this paper, the shape structure and motion characteristics of sailfish are observed, and a bionic sailfish robot is designed that

Cited by 6SourceScholar
2024

Design and Analysis of Soft Hybrid-Driven Manipulator with Variable Stiffness and Multiple Motion Patterns

ICRA 2024poster

Soft manipulators offer the advantages of safety and adaptability. However, due to insufficient stiffness and single motion mode limitations, existing soft manipulators usually exhibit low load capacity and small working space. To address this problem, we propose a novel soft hybrid-driven manipulat…

Cited by 0SourceScholar
2024

DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

CVPR 2024highlight

Diffusion models have achieved great success in synthesizing high-quality images. However generating high-resolution images with diffusion models is still challenging due to the enormous computational costs resulting in a prohibitive latency for interactive applications. In this paper we propose Dis…

2024

Dynamic Discounted Counterfactual Regret Minimization

ICLR 2024spotlight

Counterfactual regret minimization (CFR) is a family of iterative algorithms showing promising results in solving imperfect-information games. Recent novel CFR variants (e.g., CFR+, DCFR) have significantly improved the convergence rate of the vanilla CFR. The key to these CFR variants’ performance…

2024

Efficient Multi-task Reinforcement Learning with Cross-Task Policy Guidance

NeurIPS 2024poster

Multi-task reinforcement learning endeavors to efficiently leverage shared information across various tasks, facilitating the simultaneous learning of multiple tasks. Existing approaches primarily focus on parameter sharing with carefully designed network structures or tailored optimization procedur…

Cited by 1SourcePDFScholar
2024

Evaluating Copyright Takedown Methods for Language Models

NeurIPS 2024poster

Language models (LMs) derive their capabilities from extensive training on diverse data, including copyrighted material. These models can memorize and generate content similar to their training data, potentially risking legal issues like copyright infringement. Therefore, model creators are motivat…

Cited by 21SourcePDFScholar
2024

IIANet: An Intra- and Inter-Modality Attention Network for Audio-Visual Speech Separation

ICML 2024poster

Recent research has made significant progress in designing fusion modules for audio-visual speech separation. However, they predominantly focus on multi-modal fusion at a single temporal scale of auditory and visual features without employing selective attention mechanisms, which is in sharp contras…

2024

LEFormer: A Hybrid CNN-Transformer Architecture for Accurate Lake Extraction from Remote Sensing Imagery

ICASSP 2024accepted

Lake extraction from remote sensing images is challenging due to the complex lake shapes and inherent data noises. Existing methods suffer from blurred segmentation boundaries and poor foreground modeling. This paper proposes a hybrid CNN-Transformer architecture, called LEFormer, for accurate lake…

Cited by 0SourceScholar
2024

Learning to Localize Actions in Instructional Videos with LLM-Based Multi-Pathway Text-Video Alignment

ECCV 2024poster

"Learning to localize temporal boundaries of procedure steps in instructional videos is challenging due to the limited availability of annotated large-scale training videos. Recent works focus on learning the cross-modal alignment between video segments and ASR-transcripted narration texts through c…

Cited by 2SourcePDFScholar
2024

Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models

ECCV 2024poster

"This study addresses the Domain-Class Incremental Learning problem, a realistic but challenging continual learning scenario where both the domain distribution and target classes vary across tasks. To handle these diverse tasks, pre-trained Vision-Language Models (VLMs) are introduced for their stro…

2024

Minimizing Weighted Counterfactual Regret with Optimistic Online Mirror Descent

IJCAI 2024poster

Counterfactual regret minimization (CFR) is a family of algorithms for effectively solving imperfect-information games. It decomposes the total regret into counterfactual regrets, utilizing local regret minimization algorithms, such as Regret Matching (RM) or RM+, to minimize them. Recent research e…

2024

Multiagent Gumbel MuZero: Efficient Planning in Combinatorial Action Spaces

AAAI 2024technical

AlphaZero and MuZero have achieved state-of-the-art (SOTA) performance in a wide range of domains, including board games and robotics, with discrete and continuous action spaces. However, to obtain an improved policy, they often require an excessively large number of simulations, especially for doma…

2024

Not All Tasks Are Equally Difficult: Multi-Task Deep Reinforcement Learning with Dynamic Depth Routing

AAAI 2024technical

Multi-task reinforcement learning endeavors to accomplish a set of different tasks with a single policy. To enhance data efficiency by sharing parameters across multiple tasks, a common practice segments the network into distinct modules and trains a routing network to recombine these modules into t…

2024

RTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation

ICLR 2024poster

Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing state-of-the-art (SOTA) models operate in the time domain. However, their overly sim…

2024

Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Network

NeurIPS 2024spotlight

Real-world Image Dehazing (RID) aims to alleviate haze-induced degradation in real-world settings. This task remains challenging due to the complexities in accurately modeling real haze distributions and the scarcity of paired real-world data. To address these challenges, we first introduce a cooper…

2024

Rethinking Video-Text Understanding: Retrieval from Counterfactually Augmented Data

ECCV 2024poster

"Recent video-text foundation models have demonstrated strong performance on a wide variety of downstream video understanding tasks. Can these video-text models genuinely understand the contents of natural videos? Standard video-text evaluations could be misleading as many questions can be inferred…

Cited by 2SourcePDFScholar
2024

Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objects

ICLR 2024poster

Camouflaged object detection (COD) is the challenging task of identifying camouflaged objects visually blended into surroundings. Albeit achieving remarkable success, existing COD detectors still struggle to obtain precise results in some challenging cases. To handle this problem, we draw inspiratio…

2024

Towards Offline Opponent Modeling with In-context Learning

ICLR 2024poster

Opponent modeling aims at learning the opponent's behaviors, goals, or beliefs to reduce the uncertainty of the competitive environment and assist decision-making. Existing work has mostly focused on learning opponent models online, which is impractical and inefficient in practical scenarios. To thi…

Cited by 5SourcePDFScholar
2023

An efficient encoder-decoder architecture with top-down attention for speech separation

ICLR 2023poster

Deep neural networks have shown excellent prospects in speech separation tasks. However, obtaining good results while keeping a low model complexity remains challenging in real-world applications. In this paper, we provide a bio-inspired efficient encoder-decoder architecture by mimicking the brain’…

2023

Automatic Grouping for Efficient Cooperative Multi-Agent Reinforcement Learning

NeurIPS 2023poster

Grouping is ubiquitous in natural systems and is essential for promoting efficiency in team coordination. This paper proposes a novel formulation of Group-oriented Multi-Agent Reinforcement Learning (GoMARL), which learns automatic grouping without domain knowledge for efficient cooperation. In cont…

2023

Camouflaged Object Detection With Feature Decomposition and Edge Reconstruction

CVPR 2023poster

Camouflaged object detection (COD) aims to address the tough issue of identifying camouflaged objects visually blended into the surrounding backgrounds. COD is a challenging task due to the intrinsic similarity of camouflaged objects with the background, as well as their ambiguous boundaries. Existi…

Cited by 260SourcePDFScholar
2023

Conditional Image-to-Video Generation With Latent Flow Diffusion Models

CVPR 2023poster

Conditional image-to-video (cI2V) generation aims to synthesize a new plausible video starting from an image (e.g., a person's face) and a condition (e.g., an action class label like smile). The key challenge of the cI2V task lies in the simultaneous generation of realistic spatial appearance and te…

2023

Degradation-Resistant Unfolding Network for Heterogeneous Image Fusion

ICCV 2023poster

Heterogeneous image fusion (HIF) techniques aim to enhance image quality by merging complementary information from images captured by different sensors. Among these algorithms, deep unfolding network (DUN)-based methods achieve promising performance but still suffer from two issues: they lack a degr…

Cited by 32PDFScholar
2023

Few-Shot Video Classification via Representation Fusion and Promotion Learning

ICCV 2023poster

Recent few-shot video classification (FSVC) works achieve promising performance by capturing similarity across support and query samples with different temporal alignment strategies or learning discriminative features via Transformer block within each episode. However, they ignore two important issu…

Cited by 13PDFScholar
2023

Privacy Implications of Retrieval-Based Language Models

EMNLP 2023long main

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts by incorporating retrieved text from external datastores. While it is well known that parametric models are prone to leaking private data, it rema…

Cited by 0SourcecodeScholar
2023

PruMUX: Augmenting Data Multiplexing with Model Compression

ACL 2023findings

As language models increase in size by the day, methods for efficient inference are critical to leveraging their capabilities for various applications. Prior work has investigated techniques like model pruning, knowledge distillation, and data multiplexing to increase model throughput without sacrif…

2023

Source-Free Video Domain Adaptation With Spatial-Temporal-Historical Consistency Learning

CVPR 2023poster

Source-free domain adaptation (SFDA) is an emerging research topic that studies how to adapt a pretrained source model using unlabeled target data. It is derived from unsupervised domain adaptation but has the advantage of not requiring labeled source data to learn adaptive models. This makes it par…

2023

Towards Realizing the Value of Labeled Target Samples: A Two-Stage Approach for Semi-Supervised Domain Adaptation

ICASSP 2023accepted

Semi-Supervised Domain Adaptation (SSDA) is a recently emerging research topic that extends from the widely-investigated Unsupervised Domain Adaptation (UDA) by further having a few target samples labeled, i.e., the model is trained with labeled source samples, unlabeled target samples as well as a…

Cited by 0SourceScholar
2023

Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Grouping

NeurIPS 2023poster

Weakly-Supervised Concealed Object Segmentation (WSCOS) aims to segment objects well blended with surrounding environments using sparsely-annotated data for model training. It remains a challenging task since (1) it is hard to distinguish concealed objects from the background due to the intrinsic s…

Cited by 132SourcePDFScholar
2022

Actor-Critic Policy Optimization in a Large-Scale Imperfect-Information Game

ICLR 2022poster

The deep policy gradient method has demonstrated promising results in many large-scale games, where the agent learns purely from its own experience. Yet, policy gradient methods with self-play suffer convergence problems to a Nash Equilibrium (NE) in multi-agent situations. Counterfactual regret min…

Cited by 33SourcePDFScholar
2022

AlphaHoldem: High-Performance Artificial Intelligence for Heads-Up No-Limit Poker via End-to-End Reinforcement Learning

AAAI 2022technical

Heads-up no-limit Texas hold’em (HUNL) is the quintessential game with imperfect information. Representative priorworks like DeepStack and Libratus heavily rely on counter-factual regret minimization (CFR) and its variants to tackleHUNL. However, the prohibitive computation cost of CFRiteration make…

2022

AutoCFR: Learning to Design Counterfactual Regret Minimization Algorithms

AAAI 2022technical

Counterfactual regret minimization (CFR) is the most commonly used algorithm to approximately solving two-player zero-sum imperfect-information games (IIGs). In recent years, a series of novel CFR variants such as CFR+, Linear CFR, DCFR have been proposed and have significantly improved the converge…

2022

Greedy when Sure and Conservative when Uncertain about the Opponents

ICML 2022spotlight

We develop a new approach, named Greedy when Sure and Conservative when Uncertain (GSCU), to competing online against unknown and nonstationary opponents. GSCU improves in four aspects: 1) introduces a novel way of learning opponent policy embeddings offline; 2) trains offline a single best response…

2022

Multiagent Q-learning with Sub-Team Coordination

NeurIPS 2022accept

In many real-world cooperative multiagent reinforcement learning (MARL) tasks, teams of agents can rehearse together before deployment, but then communication constraints may force individual agents to execute independently when deployed. Centralized training and decentralized execution (CTDE) is in…

Cited by 10SourcePDFScholar
2022

Recovering Private Text in Federated Learning of Language Models

NeurIPS 2022accept

Federated learning allows distributed users to collaboratively train a model while keeping each user’s data private. Recently, a growing body of work has demonstrated that an eavesdropping attacker can effectively recover image data from gradients transmitted during federated learning. However, litt…

2022

StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis

CVPR 2022poster

Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for robustness and fairness, e.g., inability to synthesize the face…

Cited by 61PDFcodeScholar
2021

ECACL: A Holistic Framework for Semi-Supervised Domain Adaptation

ICCV 2021poster

This paper studies Semi-Supervised Domain Adaptation (SSDA), a practical yet under-investigated research topic that aims to learn a model of good performance using unlabeled samples and a few labeled samples in the target domain, with the help of labeled samples from a source domain. Several SSDA me…

Cited by 76PDFcodeScholar
2021

Evaluating Gradient Inversion Attacks and Defenses in Federated Learning

NeurIPS 2021oral

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the clients' private data. This paper evaluates existing attacks a…

2021

MR Image Super-Resolution With Squeeze and Excitation Reasoning Attention Network

CVPR 2021poster

High-quality high-resolution (HR) magnetic resonance (MR) images afford more detailed information for reliable diagnosis and quantitative image analyses. Deep convolutional neural networks (CNNs) have shown promising ability for MR image super-resolution (SR) given low-resolution (LR) MR images. The…

Cited by 107PDFScholar
2021

Pushing The Limit of Type I Codebook For Fdd Massive Mimo Beamforming: A Channel Covariance Reconstruction Approach

ICASSP 2021accepted

There is a fundamental trade-off between the channel representation resolution of codebooks and the overheads of feedback communications in the fifth generation new radio (5G NR) frequency division duplex (FDD) massive multiple-input and multiple-output (MIMO) systems. In particular, two types of co…

Cited by 0SourceScholar
2021

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

NeurIPS 2021poster

Recent advances in the design of neural network architectures, in particular those specialized in modeling sequences, have provided significant improvements in speech separation performance. In this work, we propose to use a bio-inspired architecture called Fully Recurrent Convolutional Neural Netwo…

2021

Video Matting via Consistency-Regularized Graph Neural Networks

ICCV 2021poster

Learning temporally consistent foreground opacity from videos, i.e., video matting, has drawn great attention due to the blossoming of video conferencing. Previous approaches are built on top of image matting models, which fail in maintaining the temporal coherence when being adapted to videos. They…

Cited by 32PDFcodeScholar
2020

Cross-Domain Document Object Detection: Benchmark Suite and Method

CVPR 2020poster

Decomposing images of document pages into high-level semantic regions (e.g., figures, tables, paragraphs), document object detection (DOD) is fundamental for downstream tasks like intelligent document editing and understanding. DOD remains a challenging problem as document objects vary significantly…

Cited by 59PDFcodeScholar
2020

InstaHide: Instance-hiding Schemes for Private Distributed Learning

ICML 2020poster

How can multiple distributed entities train a shared deep net on their private data while protecting data privacy? This paper introduces InstaHide, a simple encryption of training images. Encrypted images can be used in standard deep learning pipelines (PyTorch, Federated Learning etc.) with no addi…

2020

Patient-Specific Effects of Medication Using Latent Force Models with Gaussian Processes

AISTATS 2020poster

A multi-output Gaussian process (GP) is a flexible Bayesian nonparametric framework that has proven useful in jointly modeling the physiological states of patients in medical time series data. However, capturing the short-term effects of drugs and therapeutic interventions on patient physiological s…

2020

Potential Driven Reinforcement Learning for Hard Exploration Tasks

IJCAI 2020poster

Experience replay plays a crucial role in Reinforcement Learning (RL), enabling the agent to remember and reuse experience from the past. Most previous methods sample experience transitions using simple heuristics like uniformly sampling or prioritizing those good ones. Since humans can learn from b…

2020

Vision Global Localization with Semantic Segmentation and Interest Feature Points

IROS 2020poster

In this work, we present a vision-only global localization architecture for autonomous vehicle applications, and achieves centimeter-level accuracy and high robustness in various scenarios. We first apply pixel-wise segmentation to the front-view mono camera and extract the semantic features, e.g. p…

Cited by 5SourceScholar
2019

Residual Non-local Attention Networks for Image Restoration

ICLR 2019poster

In this paper, we propose a residual non-local attention network for high-quality image restoration. Without considering the uneven distribution of information in the corrupted images, previous methods are restricted by local convolutional operation and equal treatment of spatial- and channel-wise f…

2019

Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective

ICCV 2019poster

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from one feature space to the other. Despite being reasonable, p…

Cited by 167PDFcodeScholar
2018

Deep Cost-Sensitive and Order-Preserving Feature Learning for Cross-Population Age Estimation

CVPR 2018poster

Facial age estimation from a face image is an important yet very challenging task in computer vision, since humans with different races and/or genders, exhibit quite different patterns in their facial aging processes. To deal with the influence of race and gender, previous methods perform age estima…

Cited by 36SourcePDFScholar
2018

Image Super-Resolution Using Very Deep Residual Channel Attention Networks

ECCV 2018poster

Convolutional neural network (CNN) depth is of crucial importance for image super-resolution (SR). However, we observe that deeper networks for image SR are more difficult to train. The low-resolution (LR) inputs and features contain abundant low-frequency information, which is treated equally acros…

2015

Line-Based Multi-Label Energy Optimization for Fisheye Image Rectification and Calibration

CVPR 2015poster

Fisheye image rectification and estimation of intrinsic parameters for real scenes have been addressed in the literature by using line information on the distorted images. In this paper, we propose an easily implemented fisheye image rectification algorithm with line constrains in the undistorted pe…

Cited by 65SourcePDFScholar