← Search

Nick Barnes

28 accepted papers

2026

NoiseSDF2NoiseSDF: Learning Clean Neural Fields from Noisy Supervision

ICML 2026poster

Reconstructing accurate implicit surface representations from point clouds remains a challenging task, particularly when data is captured using low-quality scanning devices. These point clouds often contain substantial noise, leading to inaccurate surface reconstructions. Inspired by the Noise2Noise…

Cited by 0SourceScholar
2025

Open Set Label Shift with Test Time Out-of-Distribution Reference

CVPR 2025poster

Open set label shift (OSLS) occurs when label distributions change from a source to a target distribution, and the target distribution has an additional out-of-distribution (OOD) class.In this work, we build estimators for both source and target open set label distributions using a source domain in-…

2024

LAM3D: Large Image-Point Clouds Alignment Model for 3D Reconstruction from Single Image

NeurIPS 2024poster

Large Reconstruction Models have made significant strides in the realm of automated 3D content generation from single or multiple input images. Despite their success, these models often produce 3D meshes with geometric inaccuracies, stemming from the inherent challenges of deducing 3D shapes solely…

Cited by 3SourcePDFScholar
2024

Self-Calibrating Vicinal Risk Minimisation for Model Calibration

CVPR 2024poster

Model calibration measuring the alignment between the prediction accuracy and model confidence is an important metric reflecting model trustworthiness. Existing dense binary classification methods without proper regularisation of model confidence are prone to being over-confident. To calibrate Deep…

2023

Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning

CVPR 2023poster

Self-supervised audio-visual source localization aims to locate sound-source objects in video frames without extra annotations. Recent methods often approach this goal with the help of contrastive learning, which assumes only the audio and visual contents from the same video are positive samples for…

2023

Model Calibration in Dense Classification with Adaptive Label Perturbation

ICCV 2023poster

For safety-related applications, it is crucial to produce trustworthy deep neural networks whose prediction is associated with confidence that can represent the likelihood of correctness for subsequent decision-making. Existing dense binary classification models are prone to being over-confident. To…

Cited by 4PDFcodeScholar
2023

P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds

ICCV 2023poster

Point cloud completion aims to recover the complete shape based on a partial observation. Existing methods require either complete point clouds or multiple partial observations of the same object for learning. In contrast to previous approaches, we present Partial2Complete (P2C), the first self-supe…

Cited by 29PDFcodeScholar
2022

Energy-Based Generative Cooperative Saliency Prediction

AAAI 2022technical

Conventional saliency prediction models typically learn a deterministic mapping from an image to its saliency map, and thus fail to explain the subjective nature of human attention. In this paper, to model the uncertainty of visual saliency, we study the saliency prediction problem from the perspec…

2022

The Devil in Linear Transformer

EMNLP 2022main

Linear transformers aim to reduce the quadratic space-time complexity of vanilla transformers. However, they usually suffer from degraded performances on various tasks and corpus. In this paper, we examine existing kernel-based linear transformers and identify two key issues that lead to such perfor…

2022

Transmission-Guided Bayesian Generative Model for Smoke Segmentation

AAAI 2022technical

Smoke segmentation is essential to precisely localize wildfire so that it can be extinguished in an early phase. Although deep neural networks have achieved promising results on image segmentation tasks, they are prone to be overconfident for smoke segmentation due to its non-rigid shape and transpare…

2021

Conditional Generative Modeling via Learning the Latent Space

ICLR 2021poster

Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework for conditional generation in multimodal spaces, that uses lat…

2021

Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction

NeurIPS 2021poster

Vision transformer networks have shown superiority in many computer vision tasks. In this paper, we take a step further by proposing a novel generative vision transformer with latent variables following an informative energy-based prior for salient object detection. Both the vision transformer netwo…

Cited by 110SourcePDFScholar
2021

RGB-D Saliency Detection via Cascaded Mutual Information Minimization

ICCV 2021poster

Existing RGB-D saliency detection models do not explicitly encourage RGB and depth to achieve effective multi-modal learning. In this paper, we introduce a novel multi-stage cascaded learning framework via mutual information minimization to explicitly model the multi-modal information between RGB im…

Cited by 139PDFcodeScholar
2021

Rethinking conditional GAN training: An approach using geometrically structured latent manifolds

NeurIPS 2021poster

Conditional GANs (cGAN), in their rudimentary form, suffer from critical drawbacks such as the lack of diversity in generated outputs and distortion between the latent and output manifolds. Although efforts have been made to improve results, they can suffer from unpleasant side-effects such as the…

2021

Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion

CVPR 2021poster

Given the prominence of current 3D sensors, a fine-grained analysis on the basic point cloud data is worthy of further investigation. Particularly, real point cloud scenes can intuitively capture complex surroundings in the real world, but due to 3D data's raw nature, it is very challenging for mach…

Cited by 291PDFcodeScholar
2021

Simultaneously Localize, Segment and Rank the Camouflaged Objects

CVPR 2021poster

Camouflage is a key defence mechanism across species that is critical to survival. Common camouflage include background matching, imitating the color and pattern of the environment, and disruptive coloration, disguising body outlines. Camouflaged object detection (COD) aims to segment camouflaged ob…

Cited by 472PDFcodeScholar
2021

Weakly Supervised Video Salient Object Detection

CVPR 2021poster

Significant performance improvement has been achieved for fully-supervised video salient object detection with the pixel-wise labeled training datasets, which are timeconsuming and expensive to obtain. To relieve the burden of data annotation, we present the first weakly supervised video salient obj…

Cited by 93PDFcodeScholar
2020

From Depth What Can You See? Depth Completion via Auxiliary Image Reconstruction

CVPR 2020poster

Depth completion recovers dense depth from sparse measurements, e.g., LiDAR. Existing depth-only methods use sparse depth as the only input. However, these methods may fail to recover semantics consistent boundaries, or small/thin objects due to 1) the sparse nature of depth points and 2) the lack o…

Cited by 100PDFScholar
2020

Learning Noise-Aware Encoder-Decoder from Noisy Labels by Alternating Back-Propagation for Saliency Detection

ECCV 2020poster

In this paper, we propose a noise-aware encoder-decoder framework to disentangle a clean saliency predictor from noisy training examples, where the noisy labels are generated by unsupervised handcrafted feature-based methods. The proposed model consists of two sub-models parameterized by neural netw…

Cited by 60SourcePDFScholar
2020

Reducing the Sim-to-Real Gap for Event Cameras

ECCV 2020poster

Event cameras are paradigm-shifting novel sensors that report asynchronous, per-pixel brightness changes called `events' with unparalleled low latency. This makes them ideal for high speed, high dynamic range scenes where conventional cameras would fail. Recent work has demonstrated impressive resul…

2020

Spectral-GANs for High-Resolution 3D Point-cloud Generation

IROS 2020poster

Point-clouds are a popular choice for robotics and computer vision tasks due to their accurate shape description and direct acquisition from range-scanners. This demands the ability to synthesize and reconstruct high-quality point-clouds. Current deep generative models for 3D data generally work on…

Cited by 42SourcecodeScholar
2020

UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoders

CVPR 2020oral

In this paper, we propose the first framework (UCNet) to employ uncertainty for RGB-D saliency detection by learning from the data labeling process. Existing RGB-D saliency detection methods treat the saliency detection task as a point estimation problem, and produce a single saliency map following…

Cited by 420PDFScholar