← Search

Mingming Gong

119 accepted papers

2026

AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing

ICML 2026spotlight

Recent studies have extended diffusion-based instruction-driven 2D image editing pipelines to 3D Gaussian Splatting (3DGS), enabling faithful manipulation of 3DGS assets and greatly advancing 3DGS content creation. However, it also exposes these assets to serious risks of unauthorized editing and ma…

Cited by 0SourceScholar
2026

Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning

ICLR 2026poster

Directed Acyclic Graphs (DAGs) are a standard tool in causal modeling, but their suitability for capturing the complexity of large-scale multimodal data is questionable. In practice, real-world multimodal datasets are often collected from heterogeneous generative processes that do not conform to a s…

Cited by 0SourceScholar
2026

Do You Want to Know if Two Distributions Are Close to Each Other?Testing the Closeness With Statistical Significance

ICML 2026poster

Are two distributions close to each other with statistical significance? Distribution closeness testing (DCT) formalizes this question by testing whether the distance between a distribution pair is at least $\epsilon$-far. Existing DCT methods mainly measure discrepancies between a distribution pair…

Cited by 0SourceScholar
2026

FedReLa: Imbalanced Federated Learning via Re-Labeling

ICML 2026poster

Federated learning has emerged as the foremost approach for decentralized model training with privacy preserving. The global class imbalance and cross-client data heterogeneity naturally coexist, and the mismatch between local and global imbalances exacerbates the performance degradation of the aggr…

Cited by 0SourceScholar
2026

I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?

ICLR 2026poster

Recent empirical evidence shows that LLM representations encode human-interpretable concepts. Nevertheless, the mechanisms by which these representations emerge remain largely unexplored. To shed further light on this, we introduce a novel generative model that generates tokens on the basis of such…

Cited by 0SourceScholar
2026

Mobile-VTON: High-Fidelity On-Device Virtual Try-On

CVPR 2026

Virtual try-on (VTON) has recently achieved impressive visual fidelity, but most existing systems require uploading personal photos to cloud-based GPUs, raising privacy concerns and limiting on-device deployment. To address this, we present Mobile-VTON, a high-quality, privacy-preserving framework t

Cited by 0SourcecodeScholar
2026

Physics from Video: Identifiability of Time-Invariant Second-Order ODEs under Minimal Trajectory Conditions

ICML 2026poster

Bridging the gap between visual realism and physical understanding is a core challenge for video-based world models. We study the structural identifiability of continuous-time physical laws from raw pixels, focusing on whether an encoder-only pipeline can uniquely recover the parameters of second-or…

Cited by 0SourceScholar
2026

Reward-Preserving Counterfactual State Editing for Offline Reinforcement Learning

ICML 2026poster

Transformer sequence models such as Decision Transformer can learn strong offline policies from logged trajectories, but they can suffer from causal confusion: reliance on spurious correlations that predict reward in the data but do not reflect the true causal mechanisms of the environment. We propo…

Cited by 0SourceScholar
2026

TimeLAVA: Learning-Agnostic Valuation for Time Series Data

ICML 2026poster

Data valuation quantifies the intrinsic quality of individual samples to enable principled data curation, quality control, and robust learning. For time series in critical domains such as healthcare, finance, and industrial monitoring, effective valuation methods are essential yet fundamentally lack…

Cited by 0SourceScholar
2026

Treatment Responder Classification with Abstention

ICML 2026spotlight

Treatment responder classification seeks to learn a rule to classify individuals who will benefit from the treatment. This paper studies a new scenario in treatment responder classification when abstention is allowed, i.e., practitioners can opt out of making uncertain classification on some individ…

Cited by 0SourceScholar
2025

A Robust Method to Discover Causal or Anticausal Relation

ICLR 2025poster

Understanding whether the data generative process follows causal or anticausal relations is important for many applications. Existing causal discovery methods struggle with high-dimensional perceptual data such as images. Moreover, they require well-labeled data, which may not be feasible due to mea…

Cited by 0SourcePDFScholar
2025

A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery

ICLR 2025poster

Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery. In this work, we explore heteroscedastic symmetric noise models (HSNMs), where the effect $Y$ is modeled as $Y = f(X) + \sigma(X)N$, with $X$…

Cited by 0SourcePDFScholar
2025

A Unified Data Representation Learning for Non-parametric Two-sample Testing

UAI 2025

Learning effective data representations has been crucial in non-parametric two-sample testing. Common approaches will first split data into training and test sets and then learn data representations purely on the training set. However, recent theoretical studies have shown that, as long as the sampl

Cited by 0SourcePDFScholar
2025

Analytic DAG Constraints for Differentiable DAG Learning

ICLR 2025poster

Recovering the underlying Directed Acyclic Graph (DAG) structures from observational data presents a formidable challenge, partly due to the combinatorial nature of the DAG-constrained optimization problem. Recently, researchers have identified gradient vanishing as one of the primary obstac…

2025

DIDiffGes: Decoupled Semi-Implicit Diffusion Models for Real-time Gesture Generation from Speech

AAAI 2025technical

Diffusion models have demonstrated remarkable synthesis quality and diversity in generating co-speech gestures. However, the computationally intensive sampling steps associated with diffusion models hinder their practicality in real-world applications. Hence, we present DIDiffGes, for a Decoupled…

Cited by 0SourcePDFScholar
2025

Decentralized Dynamic Cooperation of Personalized Models for Federated Continual Learning

NeurIPS 2025poster

Federated continual learning (FCL) has garnered increasing attention for its ability to support distributed computation in environments with evolving data distributions. However, the emergence of new tasks introduces both temporal and cross-client shifts, making catastrophic forgetting a critical ch…

Cited by 0SourcecodeScholar
2025

Detecting Generated Images by Fitting Natural Image Distributions

NeurIPS 2025spotlight

The increasing realism of generated images has raised significant concerns about their potential misuse, necessitating robust detection methods. Current approaches mainly rely on training binary classifiers, which depend heavily on the quantity and quality of available generated images. In this work…

Cited by 0SourceScholar
2025

Enhancing Treatment Effect Estimation via Active Learning: A Counterfactual Covering Perspective

ICML 2025poster

Although numerous complex algorithms for treatment effect estimation have been developed in recent years, their effectiveness remains limited when handling insufficiently labeled training sets due to the high cost of labeling the post-treatment effect, e.g., the expensive tumor imaging or biopsy pro…

2025

Extracting Rare Dependence Patterns via Adaptive Sample Reweighting

ICML 2025poster

Discovering dependence patterns between variables from observational data is a fundamental issue in data analysis. However, existing testing methods often fail to detect subtle yet critical patterns that occur within small regions of the data distribution--patterns we term rare dependence. These rar…

Cited by 0SourcePDFScholar
2025

Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-Synthesized Images

RA-L 2025

Autonomous Underwater Vehicles (AUVs) play a crucial role in underwater exploration. Vision-based methods offer cost-effective solutions for localization and mapping in the absence of conventional sensors like GPS and LiDAR. However, underwater environments present significant challenges for feature

Cited by 2SourceScholar
2025

LaVin-DiT: Large Vision Diffusion Transformer

CVPR 2025poster

This paper presents the Large Vision Diffusion Transformer (LaVin-DiT), a scalable and unified foundation model designed to tackle over 20 computer vision tasks in a generative framework. Unlike existing large vision models directly adapted from natural language processing architectures, which rely…

2025

Learning Imbalanced Data with Beneficial Label Noise

ICML 2025poster

Data imbalance is a common factor hindering classifier performance. Data-level approaches for imbalanced learning, such as resampling, often lead to information loss or generative errors. Building on theoretical studies of imbalance ratio in binary classification, it is found that adding suitable la…

Cited by 0SourcePDFScholar
2025

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning

ICLR 2025poster

Low-rank adaptation (LoRA) has become a prevalent method for adapting pre-trained large language models to downstream tasks. However, the simple low-rank decomposition form may constrain the optimization flexibility. To address this limitation, we introduce Location-aware Cosine Adaptation (LoCA), a…

Cited by 0SourcePDFScholar
2025

MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentation

NeurIPS 2025poster

Reasoning segmentation aims to segment target objects in complex scenes based on human intent and spatial reasoning. While recent multimodal large language models (MLLMs) have demonstrated impressive 2D image reasoning segmentation, adapting these capabilities to 3D scenes remains underexplored. In…

Cited by 0SourceScholar
2025

MissScore: High-Order Score Estimation in the Presence of Missing Data

ICML 2025poster

Score-based generative models are essential in various machine learning applications, with strong capabilities in generation quality. In particular, high-order derivatives (scores) of data density offer deep insights into data distributions, building on the proven effectiveness of first-order scores…

Cited by 0SourcePDFScholar
2025

Mitigating Spurious Correlations via Counterfactual Contrastive Learning

EMNLP 2025

Identifying causal relationships rather than spurious correlations between words and class labels plays a crucial role in building robust text classifiers. Previous studies proposed using causal effects to distinguish words that are causally related to the sentiment, and then building robust text cl

Cited by 0SourcePDFScholar
2025

On the Identification of Temporal Causal Representation with Instantaneous Dependence

ICLR 2025oral

Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal processes do not have instantaneous relations. Although some recent methods achieve identifiability in the instantaneous…

Cited by 6SourcePDFScholar
2025

Optimal Transport for Time Series Imputation

ICLR 2025poster

Missing data imputation through distribution alignment has demonstrated advantages for non-temporal datasets but exhibits suboptimal performance in time-series applications. The primary obstacle is crafting a discrepancy measure that simultaneously (1) captures temporal patterns—accounting for perio…

2025

Practical Kernel Selection for Kernel-based Conditional Independence Test

NeurIPS 2025poster

Conditional independence (CI) testing is a fundamental yet challenging task in modern statistics and machine learning. One pivotal class of methods for assessing conditional independence encompasses kernel-based approaches, known for assessing CI by detecting general conditional dependence without…

Cited by 0SourceScholar
2025

Semantic-guided Cross-Modal Prompt Learning for Skeleton-based Zero-shot Action Recognition

CVPR 2025poster

Skeleton-based human action recognition is promising due to its privacy preservation, robustness to visual challenges, and computational efficiency. Especially, the practical necessity to recognize unseen actions has led to increased interest in zero-shot skeleton-based action recognition (ZSSAR). E…

Cited by 0SourcePDFScholar
2025

SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training

CVPR 2025highlight

Existing text-to-image (T2I) diffusion models face several limitations, including large model sizes, slow runtime, and low-quality generation on mobile devices. This paper aims to address all of these challenges by developing an extremely small and fast T2I model that generates high-resolution and h…

2025

Surprise3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes

NeurIPS 2025poster

The integration of language and 3D perception is critical for embodied AI and robotic systems to perceive, understand, and interact with the physical world. Spatial reasoning, a key capability for understanding spatial relationships between objects, remains underexplored in current 3D vision-languag…

Cited by 0SourceScholar
2025

Towards Accurate Time Series Forecasting via Implicit Decoding

NeurIPS 2025poster

Recent booming time series models have demonstrated remarkable forecasting performance. However, these methods often place greater focus on more effectively modelling the historical series, largely neglecting the forecasting phase, which generates long-term forecasts by separately predicting multipl…

Cited by 0SourcecodeScholar
2025

UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation

CVPR 2025poster

Recently, text-to-image generation models have achieved remarkable advancements, particularly with diffusion models facilitating high-quality image synthesis from textual descriptions. However, these models often struggle with achieving precise control over pixel-level layouts, object appearances, a…

2024

A Variational Framework for Estimating Continuous Treatment Effects with Measurement Error

ICLR 2024poster

Estimating treatment effects has numerous real-world applications in various fields, such as epidemiology and political science. While much attention has been devoted to addressing the challenge using fully observational data, there has been comparatively limited exploration of this issue in cases w…

Cited by 2SourcePDFScholar
2024

Discovery of the Hidden World with Large Language Models

NeurIPS 2024poster

Revealing the underlying causal mechanisms in the real world is the key to the development of science. Despite the progress in the past decades, traditional causal discovery approaches (CDs) mainly rely on high-quality measured variables, usually given by human experts, to find causal relations. The…

Cited by 0SourcePDFScholar
2024

Enhancing Visual Document Understanding with Contrastive Learning in Large Visual-Language Models

CVPR 2024poster

Recently the advent of Large Visual-Language Models (LVLMs) has received increasing attention across various domains particularly in the field of visual document understanding (VDU). Different from conventional vision-language tasks VDU is specifically concerned with text-rich scenarios containing a…

Cited by 14SourcePDFScholar
2024

FreeTalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness

ICASSP 2024accepted

Current talking avatars mostly generate co-speech gestures based on audio and text of the utterance, without considering the non-speaking motion of the speaker. Furthermore, previous works on co-speech gesture generation have designed network structures based on individual gesture datasets, which re…

Cited by 0SourceScholar
2024

Grab What You Need: Rethinking Complex Table Structure Recognition with Flexible Components Deliberation

AAAI 2024technical

Recently, Table Structure Recognition (TSR) task, aiming at identifying table structure into machine readable formats, has received increasing interest in the community. While impressive success, most single table component-based methods can not perform well on unregularized table cases distracted b…

Cited by 9SourcePDFScholar
2024

HuTuMotion: Human-Tuned Navigation of Latent Motion Diffusion Models with Minimal Feedback

AAAI 2024technical

We introduce HuTuMotion, an innovative approach for generating natural human motions that navigates latent motion diffusion models by leveraging few-shot human feedback. Unlike existing approaches that sample latent variables from a standard normal prior distribution, our method adapts the prior dis…

Cited by 6SourcePDFScholar
2024

Identifiability Analysis of Linear ODE Systems with Hidden Confounders

NeurIPS 2024poster

The identifiability analysis of linear Ordinary Differential Equation (ODE) systems is a necessary prerequisite for making reliable causal inferences about these systems. While identifiability has been well studied in scenarios where the system is fully observable, the conditions for identifiability…

Cited by 0SourcePDFScholar
2024

Identifiable Latent Polynomial Causal Models through the Lens of Change

ICLR 2024poster

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as \textit{identifiability}. A recent breakthrough explores identifiability…

Cited by 15SourcePDFScholar
2024

Improving Non-Transferable Representation Learning by Harnessing Content and Style

ICLR 2024spotlight

Non-transferable learning (NTL) aims to restrict the generalization of models toward the target domain(s). To this end, existing works learn non-transferable representations by reducing statistical dependence between the source and target domain. However, such statistical methods essentially neglect…

Cited by 24SourcePDFScholar
2024

In-N-Out: Lifting 2D Diffusion Prior for 3D Object Removal via Tuning-Free Latents Alignment

NeurIPS 2024poster

Neural representations for 3D scenes have made substantial advancements recently, yet object removal remains a challenging yet practical issue, due to the absence of multi-view supervision over occluded areas. Diffusion Models (DMs), trained on extensive 2D images, show diverse and high-fidelity ge…

Cited by 0SourcePDFScholar
2024

Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach

ICLR 2024poster

Fair machine learning aims to prevent discrimination against individuals or sub-populations based on sensitive attributes such as gender and race. In recent years, causal inference methods have been increasingly used in fair machine learning to measure unfairness by causal effects. However, current…

Cited by 6SourcePDFScholar
2024

Neural Collapse Inspired Feature Alignment for Out-of-Distribution Generalization

NeurIPS 2024poster

The spurious correlation between the background features of the image and its label arises due to that the samples labeled with the same class in the training set often co-occurs with a specific background, which will cause the encoder to extract non-semantic features for classification, resulting i…

Cited by 1SourcePDFScholar
2024

On the Recoverability of Causal Relations from Temporally Aggregated I.I.D. Data

ICML 2024poster

We consider the effect of temporal aggregation on instantaneous (non-temporal) causal discovery in general setting. This is motivated by the observation that the true causal time lag is often considerably shorter than the observational interval. This discrepancy leads to high aggregation, causing ti…

Cited by 1SourcePDFScholar
2024

Optimal Kernel Choice for Score Function-based Causal Discovery

ICML 2024poster

Score-based methods have demonstrated their effectiveness in discovering causal relationships by scoring different causal structures based on their goodness of fit to the data. Recently, Huang et al. proposed a generalized score function that can handle general data distributions and causal relation…

Cited by 3SourcePDFScholar
2024

Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognition

CVPR 2024poster

While remarkable progress has been made on supervised skeleton-based action recognition the challenge of zero-shot recognition remains relatively unexplored. In this paper we argue that relying solely on aligning label-level semantics and global skeleton features is insufficient to effectively trans…

2023

CS-Isolate: Extracting Hard Confident Examples by Content and Style Isolation

NeurIPS 2023poster

Label noise widely exists in large-scale image datasets. To mitigate the side effects of label noise, state-of-the-art methods focus on selecting confident examples by leveraging semi-supervised learning. Existing research shows that the ability to extract hard confident examples, which are close to…

2023

Combating Noisy Labels with Sample Selection by Mining High-Discrepancy Examples

ICCV 2023poster

The sample selection approach is popular in learning with noisy labels. The state-of-the-art methods train two deep networks simultaneously for sample selection, which aims to employ their different learning abilities. To prevent two networks from converging to a consensus, their divergence should b…

Cited by 53PDFcodeScholar
2023

ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding

NeurIPS 2023poster

Transformers have been recently explored for 3D point cloud understanding with impressive progress achieved. A large number of points, over 0.1 million, make the global self-attention infeasible for point cloud data. Thus, most methods propose to apply the transformer in a local region, e.g., spheri…

2023

Diversity-enhancing Generative Network for Few-shot Hypothesis Adaptation

ICML 2023poster

Generating unlabeled data has been recently shown to help address the few-shot hypothesis adaptation (FHA) problem, where we aim to train a classifier for the target domain with a few labeled target-domain data and a well-trained source-domain classifier (i.e., a source hypothesis), for the addition…

Cited by 4SourcePDFScholar
2023

Generating Dynamic Kernels via Transformers for Lane Detection

ICCV 2023poster

State-of-the-art lane detection methods often rely on specific knowledge about lanes -- such as straight lines and parametric curves -- to detect lane lines. While the specific knowledge can ease the modeling process, it poses challenges in handling lane lines with complex topologies (e.g., dense, f…

Cited by 28PDFcodeScholar
2023

Generator Identification for Linear SDEs with Additive and Multiplicative Noise

NeurIPS 2023poster

In this paper, we present conditions for identifying the generator of a linear stochastic differential equation (SDE) from the distribution of its solution process with a given fixed initial state. These identifiability conditions are crucial in causal inference using linear SDEs as they enable the…

Cited by 5SourcePDFScholar
2023

Harnessing Out-Of-Distribution Examples via Augmenting Content and Style

ICLR 2023poster

Machine learning models are vulnerable to Out-Of-Distribution (OOD) examples, such a problem has drawn much attention. However, current methods lack a full understanding of different types of OOD data: there are benign OOD data that can be properly adapted to enhance the learning performance, while…

Cited by 58SourcePDFScholar
2023

Knowledge Distillation for Feature Extraction in Underwater VSLAM

ICRA 2023poster

In recent years, learning-based feature detection and matching have outperformed manually-designed methods in in-air cases. However, it is challenging to learn the features in the underwater scenario due to the absence of annotated underwater datasets. This paper proposes a cross-modal knowl-edge di…

Cited by 9SourcecodeScholar
2023

Learning World Models with Identifiable Factorization

NeurIPS 2023poster

Extracting a stable and compact representation of the environment is crucial for efficient reinforcement learning in high-dimensional, noisy, and non-stationary environments. Different categories of information coexist in such environments -- how to effectively extract and disentangle the informati…

Cited by 16SourcePDFScholar
2023

Mosaic Representation Learning for Self-supervised Visual Pre-training

ICLR 2023top-25%

Self-supervised learning has achieved significant success in learning visual representations without the need for manual annotation. To obtain generalizable representations, a meticulously designed data augmentation strategy is one of the most crucial parts. Recently, multi-crop strategies utilizing…

2023

Multi-domain image generation and translation with identifiability guarantees

ICLR 2023top-25%

Multi-domain image generation and unpaired image-to-to-image translation are two important and related computer vision problems. The common technique for the two tasks is the learning of a joint distribution from multiple marginal distributions. However, it is well known that there can be infinitely…

2023

Multiscale Representation for Real-Time Anti-Aliasing Neural Rendering

ICCV 2023poster

The rendering scheme in neural radiance field (NeRF) is effective in rendering a pixel by casting a ray into the scene. However, NeRF yields blurred rendering results when the training images are captured at non-uniform scales, and produces aliasing artifacts if the test images are taken in distant…

Cited by 11PDFScholar
2023

Semi-Implicit Denoising Diffusion Models (SIDDMs)

NeurIPS 2023poster

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Models (DDPM) deliver high-quality, diverse samples but are slowed by an inherentl…

2023

Unpaired Image-to-Image Translation With Shortest Path Regularization

CVPR 2023poster

Unpaired image-to-image translation aims to learn proper mappings that can map images from one domain to another domain while preserving the content of the input image. However, with large enough capacities, the network can learn to map the inputs to any random permutation of images in another domai…

2023

Which is Better for Learning with Noisy Labels: The Semi-supervised Method or Modeling Label Noise?

ICML 2023poster

In real life, accurately annotating large-scale datasets is sometimes difficult. Datasets used for training deep learning models are likely to contain label noise. To make use of the dataset containing label noise, two typical methods have been proposed. One is to employ the semi-supervised method b…

Cited by 10SourcePDFScholar
2022

A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning

ICLR 2022poster

The generalization of model-based reinforcement learning (MBRL) methods to environments with unseen transition dynamics is an important yet challenging problem. Existing methods try to extract environment-specified information $Z$ from past transition segments to make the dynamics prediction model g…

2022

Adversarial Robustness Through the Lens of Causality

ICLR 2022poster

The adversarial vulnerability of deep neural networks has attracted significant attention in machine learning. As causal reasoning has an instinct for modeling distribution change, it is essential to incorporate causality into analyzing this specific type of distribution change induced by adversarial…

Cited by 105SourcePDFScholar
2022

Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint

CVPR 2022poster

Unsupervised image-to-image (I2I) translation aims to learn a domain mapping function that can preserve the semantics of the input images without paired data. However, because the underlying semantics distributions in the source and target domains are often mismatched, current distribution matching-…

Cited by 33PDFcodeScholar
2022

CRIS: CLIP-Driven Referring Image Segmentation

CVPR 2022poster

Referring image segmentation aims to segment a referent via a natural linguistic expression. Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing approaches use pretrained models to facilitate learning, yet…

Cited by 441PDFcodeScholar
2022

Counterfactual Fairness with Partially Known Causal Graph

NeurIPS 2022accept

Fair machine learning aims to avoid treating individuals or sub-populations unfavourably based on \textit{sensitive attributes}, such as gender and race. Those methods in fair machine learning that are built on causal inference ascertain discrimination and bias through causal effects. Though causali…

Cited by 33SourcePDFScholar
2022

Digging into Radiance Grid for Real-Time View Synthesis with Detail Preservation

ECCV 2022poster

"Neural Radiance Fields (NeRF) [31] series are impressive in representing scenes and synthesizing high-quality novel views. However, most previous works fail to preserve texture details and suffer from slow training speed. A recent method SNeRG [11] demonstrates that baking a trained NeRF as a Spars…

2022

Exploring Set Similarity for Dense Self-Supervised Representation Learning

CVPR 2022poster

By considering the spatial correspondence, dense self-supervised representation learning has achieved superior performance on various dense prediction tasks. However, the pixel-level correspondence tends to be noisy because of many similar misleading pixels, e.g., backgrounds. To address this issue,…

Cited by 51PDFcodeScholar
2022

Few-Shot Font Generation by Learning Fine-Grained Local Styles

CVPR 2022poster

Few-shot font generation (FFG), which aims to generate a new font with a few examples, is gaining increasing attention due to the significant reduction in labor cost. A typical FFG pipeline considers characters in a standard font library as content glyphs and transfers them to a new target font by e…

Cited by 80PDFcodeScholar
2022

Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation

CVPR 2022poster

Unpaired image-to-image translation (I2I) is an ill-posed problem, as an infinite number of translation functions can map the source domain distribution to the target distribution. Therefore, much effort has been put into designing suitable constraints, e.g., cycle consistency (CycleGAN), geometry c…

Cited by 26PDFcodeScholar
2022

MissDAG: Causal Discovery in the Presence of Missing Data with Continuous Additive Noise Models

NeurIPS 2022accept

State-of-the-art causal discovery methods usually assume that the observational data is complete. However, the missing data problem is pervasive in many practical scenarios such as clinical trials, economics, and biology. One straightforward way to address the missing data problem is first to impute…

2022

Rethinking Class-Prior Estimation for Positive-Unlabeled Learning

ICLR 2022poster

Given only positive (P) and unlabeled (U) data, PU learning can train a binary classifier without any negative data. It has two building blocks: PU class-prior estimation (CPE) and PU classification; the latter has been well studied while the former has received less attention. Hitherto, the distrib…

Cited by 26SourcePDFScholar
2022

Robust Weight Perturbation for Adversarial Training

IJCAI 2022poster

Overfitting widely exists in adversarial robust training of deep networks. An effective remedy is adversarial weight perturbation, which injects the worst-case weight perturbation during network training by maximizing the classification loss on adversarial examples. Adversarial weight perturbation h…

2022

Sample Selection with Uncertainty of Losses for Learning with Noisy Labels

ICLR 2022poster

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled data during training. However, losses are generated on-the-fly based on the model being trained with noisy labels, and thus large-loss data are likely but not certain to be…

Cited by 159SourcePDFScholar
2022

Truncated Matrix Power Iteration for Differentiable DAG Learning

NeurIPS 2022accept

Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem. Recently, DAG learning has been cast as a continuous optimization problem by characterizing the DAG constraint as a…

2022

Uncertainty Quantification in Depth Estimation via Constrained Ordinal Regression

ECCV 2022poster

"Monocular Depth Estimation (MDE) is a task to predict a dense depth map from a single image. Despite the recent progress brought by deep learning, existing methods are still prone to errors due to the ill-posed nature of MDE. Hence depth estimation systems must be self-aware of possible mistakes to…

2022

Understanding Robust Overfitting of Adversarial Training and Beyond

ICML 2022spotlight

Robust overfitting widely exists in adversarial training of deep networks. The exact underlying reasons for this are still not completely understood. Here, we explore the causes of robust overfitting by comparing the data distribution of non-overfit (weak adversary) and overfitted (strong adversary)…

2021

Class2Simi: A Noise Reduction Perspective on Learning with Noisy Labels

ICML 2021spotlight

Learning with noisy labels has attracted a lot of attention in recent years, where the mainstream approaches are in \emph{pointwise} manners. Meanwhile, \emph{pairwise} manners have shown great potential in supervised metric learning and unsupervised contrastive learning. Thus, a natural question is…

Cited by 82SourcePDFScholar
2021

Domain Adaptation with Invariant Representation Learning: What Transformations to Learn?

NeurIPS 2021poster

Unsupervised domain adaptation, as a prevalent transfer learning setting, spans many real-world applications. With the increasing representational power and applicability of neural networks, state-of-the-art domain adaptation methods make use of deep architectures to map the input features $X$ to a…

2021

Instance-dependent Label-noise Learning under a Structural Causal Model

NeurIPS 2021poster

Label noise generally degenerates the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let $X$ and $Y$ denote the instance and clean label, respectively. When $Y$ is a cause of $X$, according to which many datasets have been constructed, e.g., \text…

Cited by 90SourcePDFScholar
2021

Learning with Group Noise

AAAI 2021technical

Machine learning in the context of noise is a challenging but practical setting to plenty of real-world applications. Most of the previous approaches in this area focus on the pairwise relation (casual or correlational relationship) with noise, such as learning with noisy labels. However, the group…

Cited by 11SourcePDFScholar
2021

Not All Operations Contribute Equally: Hierarchical Operation-Adaptive Predictor for Neural Architecture Search

ICCV 2021poster

Graph-based predictors have recently shown promising results on neural architecture search (NAS). Despite their efficiency, current graph-based predictors treat all operations equally, resulting in biased topological knowledge of cell architectures. Intuitively, not all operations are equally signif…

Cited by 13PDFScholar
2020

Compressed Self-Attention for Deep Metric Learning with Low-Rank Approximation

IJCAI 2020poster

In this paper, we apply self-attention (SA) mechanism to boost the performance of deep metric learning. However, due to the pairwise similarity measurement, the cost of storing and manipulating the complete attention maps makes it infeasible for large inputs. To solve this problem, we propose a com…

Cited by 0SourcePDFScholar
2020

Domain Adaptation as a Problem of Inference on Graphical Models

NeurIPS 2020poster

This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change across domains. To develop an automated way of domain adaptatio…

2020

Domain Generalization via Entropy Regularization

NeurIPS 2020poster

Domain generalization aims to learn from multiple source domains a predictive model that can generalize to unseen target domains. One essential problem in domain generalization is to learn discriminative domain-invariant features. To arrive at this, some methods introduce a domain discriminator thro…

2020

Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learning

NeurIPS 2020poster

The transition matrix, denoting the transition relationship from clean labels to noisy labels, is essential to build statistically consistent classifiers in label-noise learning. Existing methods for estimating the transition matrix rely heavily on estimating the noisy class posterior. However, the…

Cited by 300SourcePDFScholar
2020

Hard Example Generation by Texture Synthesis for Cross-domain Shape Similarity Learning

NeurIPS 2020poster

Image-based 3D shape retrieval (IBSR) aims to find the corresponding 3D shape of a given 2D image from a large 3D shape database. The common routine is to map 2D images and 3D shapes into an embedding space and define (or learn) a shape similarity measure. While metric learning with some adaptation…

2020

LTF: A Label Transformation Framework for Correcting Label Shift

ICML 2020poster

Distribution shift is a major obstacle to the deployment of current deep learning models on real-world problems. Let $Y$ be the class label and $X$ the features. We focus on one type of distribution shift, \emph{ label shift}, where the label marginal distribution $P_Y$ changes but the conditional d…

2020

Label-Noise Robust Domain Adaptation

ICML 2020poster

Domain adaptation aims to correct the classifiers when faced with distribution shift between source (training) and target (test) domains. State-of-the-art domain adaptation methods make use of deep networks to extract domain-invariant representations. However, existing methods assume that all the in…

Cited by 38SourcePDFScholar
2020

Part-dependent Label Noise: Towards Instance-dependent Label Noise

NeurIPS 2020spotlight

Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive instances by decomposing them into parts. Annotators are therefore more likely to…

2020

Short-Term and Long-Term Context Aggregation Network for Video Inpainting

ECCV 2020poster

Video inpainting aims to restore missing regions of a video and has many applications such as video editing and object removal. However, existing methods either suffer from inaccurate short-term context aggregation or rarely explore long-term frame information. In this work, we present a novel conte…

Cited by 54SourcePDFScholar
2020

Sub-center ArcFace: Boosting Face Recognition by Large-scale Noisy Web Faces

ECCV 2020poster

Margin-based deep face recognition methods (e.g. SphereFace, CosFace, and ArcFace) have achieved remarkable success in unconstrained face recognition. However, these methods are susceptible to the massive label noise in the training data and thus require laborious human effort to clean the datasets.…

2019

Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models

ICML 2019oral

In many scientific fields, such as economics and neuroscience, we are often faced with nonstationary time series, and concerned with both finding causal relations and forecasting the values of variables of interest, both of which are particularly challenging in such nonstationary environments. In th…

Cited by 94SourcePDFScholar
2019

Data-Driven Approach to Multiple-Source Domain Adaptation

AISTATS 2019poster

A key problem in domain adaptation is determining what to transfer across different domains. We propose a data-driven method to represent these changes across multiple source domains and perform unsupervised domain adaptation. We assume that the joint distributions follow a specific generating proce…

Cited by 38SourcePDFScholar
2019

Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation

CVPR 2019poster

Supervised depth estimation has achieved high accuracy due to the advanced deep network architectures. Since the groundtruth depth labels are hard to obtain, recent methods try to learn depth estimation networks in an unsupervised way by exploring unsupervised cues, which are effective but less reli…

Cited by 229PDFcodeScholar
2019

Geometry-Consistent Generative Adversarial Networks for One-Sided Unsupervised Domain Mapping

CVPR 2019oral

Unsupervised domain mapping aims to learn a function GXY to translate domain X to Y in the absence of paired examples. Finding the optimal GXY without paired data is an ill-posed problem, so appropriate constraints are required to obtain reasonable solutions. While some prominent constraints such as…

Cited by 287PDFScholar
2019

Likelihood-Free Overcomplete ICA and Applications In Causal Discovery

NeurIPS 2019spotlight

Causal discovery witnessed significant progress over the past decades. In particular, many recent causal discovery methods make use of independent, non-Gaussian noise to achieve identifiability of the causal models. Existence of hidden direct common causes, or confounders, generally makes causal dis…

2019

Low-Dimensional Density Ratio Estimation for Covariate Shift Correction

AISTATS 2019poster

Covariate shift is a prevalent setting for supervised learning in the wild when the training and test data are drawn from different time periods, different but related domains, or via different sampling strategies. This paper addresses a transfer learning setting, with covariate shift between sourc…

Cited by 34SourcePDFScholar
2019

Specific and Shared Causal Relation Modeling and Mechanism-Based Clustering

NeurIPS 2019poster

State-of-the-art approaches to causal discovery usually assume a fixed underlying causal model. However, it is often the case that causal models vary across domains or subjects, due to possibly omitted factors that affect the quantitative causal effects. As a typical example, causal connectivity in…

2019

Twin Auxilary Classifiers GAN

NeurIPS 2019spotlight

Conditional generative models enjoy significant progress over the past few years. One of the popular conditional models is Auxiliary Classifier GAN (AC-GAN) that generates highly discriminative images by extending the loss function of GAN with an auxiliary classifier. However, the diversity of the g…

2018

An Efficient and Provable Approach for Mixture Proportion Estimation Using Linear Independence Assumption

CVPR 2018poster

In this paper, we study the mixture proportion estimation (MPE) problem in a new setting: given samples from the mixture and the component distributions, we identify the proportions of the components in the mixture distribution. To address this problem, we make use of a linear independence assumptio…

Cited by 58SourcePDFScholar
2018

Correcting the Triplet Selection Bias for Triplet Loss

ECCV 2018poster

Triplet loss, popular for metric learning, has made a great success in many computer vision tasks, such as fine-grained image classification, image retrieval, and face recognition. Considering that the number of triplets grows cubically with the size of training data, triplet mining is thus indispen…

Cited by 132SourcePDFScholar
2018

Deep Domain Generalization via Conditional Invariant Adversarial Networks

ECCV 2018poster

Domain generalization aims to learn a classification model from multiple source domains and generalize it to unseen target domains. A critical problem in domain generalization involves learning domain-invariant representations. Let $X$ and $Y$ denote the features and the labels, respectively. Under…

Cited by 890SourcePDFScholar
2018

Deep Ordinal Regression Network for Monocular Depth Estimation

CVPR 2018poster

Monocular depth estimation, which plays a crucial role in understanding 3D scene geometry, is an ill-posed prob- lem. Recent methods have gained significant improvement by exploring image-level information and hierarchical features from deep convolutional neural networks (DCNNs). These methods model…

2018

Modeling Dynamic Missingness of Implicit Feedback for Recommendation

NeurIPS 2018poster

Implicit feedback is widely used in collaborative filtering methods for recommendation. It is well known that implicit feedback contains a large number of values that are \emph{missing not at random} (MNAR); and the missing data is a mixture of negative and unknown feedback, making it difficult to l…

Cited by 71SourcePDFScholar
2016

Domain Adaptation with Conditional Transferable Components

ICML 2016poster

Domain adaptation arises in supervised learning when the training (source domain) and test (target domain) data have different distributions. Let X and Y denote the features and target, respectively, previous work on domain adaptation considers the covariate shift situation where the distribution of…

Cited by 435SourcePDFScholar
2015

Causal Inference by Identification of Vector Autoregressive Processes with Hidden Components

ICML 2015poster

A widely applied approach to causal inference from a time series X, often referred to as “(linear) Granger causal analysis”, is to simply regress present on past and interpret the regression matrix \hatB causally. However, if there is an unmeasured time series Z that influences X, then this approach…

Cited by 95SourcePDFScholar
2015

Discovering Temporal Causal Relations from Subsampled Data

ICML 2015poster

Granger causal analysis has been an important tool for causal analysis for time series in various fields, including neuroscience and economics, and recently it has been extended to include instantaneous effects between the time series to explain the contemporaneous dependence in the residuals. In th…

Cited by 110SourcePDFScholar