← Search

Sheng-Jun Huang

41 accepted papers

2026

Continuous Exposure-Time Modeling for Realistic Atmospheric Turbulence Synthesis

CVPR 2026

Atmospheric turbulence significantly degrades long-range imaging by introducing geometric warping and exposure-time-dependent blur, which adversely affects both visual quality and the performance of high-level vision tasks. Existing methods for synthesizing turbulence effects often oversimplify the

Cited by 0SourcecodeScholar
2026

Federated Data and Feature Selection by Generalized CUR Decomposition

ICML 2026poster

With the advance of federated learning (FL) in privacy-sensitive domains such as healthcare, finance, and mobile intelligence, the need for efficient and robust training becomes increasingly urgent. Communication bottlenecks, heterogeneous client distributions, and fairness requirements make it esse…

Cited by 0SourceScholar
2026

Instruction Decomposition and Action Alignment for Vision-Language Navigation

ICML 2026poster

Vision-and-Language Navigation (VLN) empowered by Multimodal Large Language Models (MLLMs) is promise, yet remains challenged by long-horizon tasks with complex user instructions. Existing approaches that continuously condition on full instructions incur high latency due to abundant visual tokens an…

Cited by 0SourceScholar
2026

MultiMedBench: A Scenario-Aware Benchmark for Evaluating Knowledge Editing in Medical VQA

AAAI 2026technical

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little attention has been paid to KE in multimodal medical scenarios. U

Cited by 0SourcePDFScholar
2026

Reflect Then Learn: Active Prompting for Information Extraction Guided by Introspective Confusion

AAAI 2026technical

Large Language Models (LLMs) show remarkable potential for few-shot information extraction (IE), yet their performance is highly sensitive to the choice of in-context examples. Conventional selection strategies often fail to provide informative guidance, as they overlook a key source of model fallib

Cited by 0SourcePDFScholar
2026

Revisiting Unknowns: Towards Effective and Efficient Open-Set Active Learning

CVPR 2026

Open-set active learning (OSAL) aims to identify informative samples for annotation when unlabeled data may contain previously unseen classes--a common challenge in safety-critical and open-world scenarios. Existing approaches typically rely on separately trained open-set detectors, introducing subs

Cited by 0SourcecodeScholar
2025

DM-POSA: Enhancing Open-World Test-Time Adaptation with Dual-Mode Matching and Prompt-Based Open Set Adaptation

IJCAI 2025

The need to generalize the pre-trained deep learning models to unknown test-time data distributions has spurred research into test-time adaptation (TTA). Existing studies have mainly focused on closed-set TTA with only covariate shifts, while largely overlooking open-set TTA that involves semantic s

Cited by 0SourcePDFScholar
2025

Efficient Heterogeneity-Aware Federated Active Data Selection

ICML 2025poster

Federated Active Learning (FAL) aims to learn an effective global model, while minimizing label queries. Owing to privacy requirements, it is challenging to design effective active data selection schemes due to the lack of cross-client query information. In this paper, we bridge this important gap b…

Cited by 0SourcePDFScholar
2025

FedDLAD: A Federated Learning Dual-Layer Anomaly Detection Framework for Enhancing Resilience Against Backdoor Attacks

IJCAI 2025

In Federated Learning (FL), the decentralized nature of client training introduces vulnerabilities, notably backdoor attacks. Prevailing anomaly detection approaches typically perform binary classification, dividing clients into trusted and untrusted groups. However, these methods face two critical

2025

Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning

ACL 2025finding

Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL). However, due to the feature divergence of an attribute (resp. object) when combined with different objects (resp. attributes), it is challenging t…

2025

Improving Generalization of Deep Neural Networks by Optimum Shifting

AAAI 2025technical

Recent studies showed that the generalization of neural networks is correlated with the sharpness of the loss landscape and flat minima suggests a better generalization ability than sharp minima. In this paper, we propose a novel method called optimum shifting, which changes the parameters of a neur…

Cited by 1SourcePDFScholar
2025

Learning to Trust Bellman Updates: Selective State-Adaptive Regularization for Offline RL

ICML 2025poster

Offline reinforcement learning (RL) aims to learn an effective policy from a static dataset. To alleviate extrapolation errors, existing studies often uniformly regularize the value function or policy updates across all states. However, due to substantial variations in data quality, the fixed regula…

2025

MLC-NC: Long-Tailed Multi-Label Image Classification Through the Lens of Neural Collapse

AAAI 2025technical

Long-tailed (LT) data distribution is common in multi-label image classification (MLC) and can significantly impact the performance of classification models. One reason is the challenge of learning unbiased instance representations (i.e. features) for imbalanced datasets. Additionally, the co-occurr…

Cited by 0SourcePDFScholar
2025

Representation-Level Counterfactual Calibration for Debiased Zero-Shot Recognition

NeurIPS 2025poster

Object–context shortcuts remain a persistent challenge in vision‑language models, undermining zero‑shot reliability when test-time scenes diverge from familiar training co-occurrences. We recast this issue as a causal inference problem and ask: Would the prediction remain if the object appeared in a…

Cited by 0SourceScholar
2025

Rethinking Epistemic and Aleatoric Uncertainty for Active Open-Set Annotation: An Energy-Based Approach

CVPR 2025poster

Active learning (AL), which iteratively queries the most informative examples from a large pool of unlabeled candidates for model training, faces significant challenges in the presence of open-set classes. Existing methods either prioritize query examples likely to belong to known classes, indicatin…

2025

StructSR: Refuse Spurious Details in Real-World Image Super-Resolution

AAAI 2025technical

Diffusion-based models have shown great promise in real-world image super-resolution (Real-ISR), but often generate content with structural errors and spurious texture details due to the empirical priors and illusions of these models. To address this issue, we introduce StructSR, a simple, effective…

2024

Causality-enhanced Discreted Physics-informed Neural Networks for Predicting Evolutionary Equations

IJCAI 2024poster

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly for dynamical systems whose solutions exhibit multi-scale or turbulent behavi…

2024

Counterfactual Reasoning for Multi-Label Image Classification via Patching-Based Training

ICML 2024poster

The key to multi-label image classification (MLC) is to improve model performance by leveraging label correlations. Unfortunately, it has been shown that overemphasizing co-occurrence relationships can cause the overfitting issue of the model, ultimately leading to performance degradation. In this p…

2024

Dirichlet-Based Prediction Calibration for Learning with Noisy Labels

AAAI 2024technical

Learning with noisy labels can significantly hinder the generalization performance of deep neural networks (DNNs). Existing approaches address this issue through loss correction or example selection methods. However, these methods often rely on the model's predictions obtained from the softmax funct…

2024

NanoAdapt: Mitigating Negative Transfer in Test Time Adaptation with Extremely Small Batch Sizes

IJCAI 2024poster

Test Time Adaptation (TTA) has garnered significant attention in recent years, with the research focus on addressing distribution shifts during test time. As one fundamental component of many TTA methods, the Batch Normalization (BN) layer plays a crucial role in enabling the model adaptability. How…

Cited by 1SourcePDFScholar
2024

One-shot Active Learning Based on Lewis Weight Sampling for Multiple Deep Models

ICLR 2024poster

Active learning (AL) for multiple target models aims to reduce labeled data querying while effectively training multiple models concurrently. Existing AL algorithms often rely on iterative model training, which can be computationally expensive, particularly for deep models. In this paper, we propose…

Cited by 4SourcePDFScholar
2024

Optimistic Critic Reconstruction and Constrained Fine-Tuning for General Offline-to-Online RL

NeurIPS 2024poster

Offline-to-online (O2O) reinforcement learning (RL) provides an effective means of leveraging an offline pre-trained policy as initialization to improve performance rapidly with limited online interactions. Recent studies often design fine-tuning strategies for a specific offline RL method and canno…

2024

Unlocking the Power of Open Set: A New Perspective for Open-Set Noisy Label Learning

AAAI 2024technical

Learning from noisy data has attracted much attention, where most methods focus on closed-set label noise. However, a more common scenario in the real world is the presence of both open-set and closed-set noise. Existing methods typically identify and handle these two types of label noise separately…

Cited by 10SourcePDFScholar
2023

ALL-E: Aesthetics-guided Low-light Image Enhancement

IJCAI 2023poster

Evaluating the performance of low-light image enhancement (LLE) is highly subjective, thus making integrating human preferences into image enhancement a necessity. Existing methods fail to consider this and present a series of potentially valid heuristic criteria for training enhancement models. In…

2023

Class-Distribution-Aware Pseudo-Labeling for Semi-Supervised Multi-Label Learning

NeurIPS 2023poster

Pseudo-labeling has emerged as a popular and effective approach for utilizing unlabeled data. However, in the context of semi-supervised multi-label learning (SSMLL), conventional pseudo-labeling methods encounter difficulties when dealing with instances associated with multiple labels and an unknow…

2023

Implicit Stochastic Gradient Descent for Training Physics-Informed Neural Networks

AAAI 2023technical

Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems, but they are still trapped in training failures when the target functions to be approximated exhibit high-frequency or multi-scale features. In this paper, we pr…

Cited by 2SourcePDFScholar
2023

Improving Lens Flare Removal with General-Purpose Pipeline and Multiple Light Sources Recovery

ICCV 2023poster

When taking images against strong light sources, the resulting images often contain heterogeneous flare artifacts. These artifacts can importantly affect image visual quality and downstream computer vision tasks. While collecting real data pairs of flare-corrupted/flare-free images for training flar…

Cited by 26PDFcodeScholar
2023

Multi-Label Knowledge Distillation

ICCV 2023poster

Existing knowledge distillation methods typically work by imparting the knowledge of output logits or intermediate feature maps from the teacher network to the student network, which is very successful in multi-class single-label learning. However, these methods can hardly be extended to the multi-l…

Cited by 24PDFcodeScholar
2022

Can Adversarial Training Be Manipulated By Non-Robust Features?

NeurIPS 2022accept

Adversarial training, originally designed to resist test-time adversarial examples, has shown to be promising in mitigating training-time availability attacks. This defense ability, however, is challenged in this paper. We identify a novel threat model named stability attack, which aims to hinder ro…

2022

Label-Aware Global Consistency for Multi-Label Learning with Single Positive Labels

NeurIPS 2022accept

In single positive multi-label learning (SPML), only one of multiple positive labels is observed for each instance. The previous work trains the model by simply treating unobserved labels as negative ones, and designs the regularization to constrain the number of expected positive labels. However, i…

Cited by 23SourcePDFScholar
2021

Asynchronous Active Learning with Distributed Label Querying

IJCAI 2021poster

Active learning tries to learn an effective model with lowest labeling cost. Most existing active learning methods work in a synchronous way, which implies that the label querying can be performed only after the model updating in each iteration. While training models is usually time-consuming, it ma…

Cited by 15SourcePDFScholar
2021

Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training

NeurIPS 2021poster

Delusive attacks aim to substantially deteriorate the test accuracy of the learning model by slightly perturbing the features of correctly labeled training examples. By formalizing this malicious attack as finding the worst-case training data within a specific $\infty$-Wasserstein ball, we show that…

2021

Improving Model Robustness by Adaptively Correcting Perturbation Levels with Active Queries

AAAI 2021technical

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise perturbations. Most existing studies assume a fixed perturbation level fo…

Cited by 13SourcePDFScholar
2020

Cost-effectively Identifying Causal Effects When Only Response Variable is Observable

ICML 2020poster

In many real tasks, we care about how to make decisions rather than mere predictions on an event, e.g. how to increase the revenue next month instead of merely knowing it will drop. The key is to identify the causal effects on the desired event. It is achievable with do-calculus if the causal struct…

Cited by 11SourcePDFScholar