← Search

Zhilu Zhang

21 accepted papers

2026

ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions

CVPR 2026

Existing hand-object interactions (HOI) methods are largely limited to rigid objects, while 4D reconstruction methods of articulated objects generally require pre-scanning the object or even multi-view videos. It remains an unexplored but significant challenge to reconstruct 4D human-articulated-obj

Cited by 0SourcecodeScholar
2026

DeAltHDR: Learning HDR Video Reconstruction from Degraded Alternating Exposure Sequences

ICLR 2026poster

High dynamic range (HDR) video can be reconstructed from low dynamic range (LDR) sequences with alternating exposures. However, most existing methods overlook the degradations (e.g., noise and blur) in LDR frames, focusing only on the brightness and position differences between them. To address this…

Cited by 0SourceScholar
2026

Deblur4DGS: 4D Gaussian Splatting from Blurry Monocular Video

AAAI 2026technical

Recent 4D reconstruction methods have yielded impressive results but rely on sharp videos as supervision. However, motion blur often occurs in videos due to camera shake and object movement, while existing methods render blurry results when using such videos for reconstructing 4D models. Although a

Cited by 0SourcePDFScholar
2026

MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling

ICLR 2026poster

Existing video generation models predominantly emphasize appearance fidelity while exhibiting limited ability to synthesize complex human motions, such as whole-body movements, long-range dynamics, and fine-grained human–environment interactions. This often leads to unrealistic or physically implaus…

Cited by 0SourceScholar
2026

UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity

ICLR 2026poster

Recently, considerable progress has been made in all-in-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation estimation-based priors, and the latter suffer from the inevitable error in degradati…

Cited by 0SourcecodeScholar
2025

Commonsense Subgraph for Inductive Relation Reasoning with Meta-learning

COLING 2025main

In knowledge graphs (KGs), predicting missing relations is a critical reasoning task. Recent subgraph-based models have delved into inductive settings, which aim to predict relations between newly added entities. While these models have demonstrated the ability for inductive reasoning, they only con…

Cited by 0SourcePDFScholar
2025

DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors

AAAI 2025technical

Dynamic 3D interaction has been attracting a lot of attention recently. However, creating such 4D content remains challenging. One solution is to animate 3D scenes with physics-based simulation, which requires manually assigning precise physical properties to the object or the simulated results woul…

2025

Exposure Bracketing Is All You Need For A High-Quality Image

ICLR 2025poster

It is highly desired but challenging to acquire high-quality photos with clear content in low-light environments. Although multi-image processing methods (using burst, dual-exposure, or multi-exposure images) have made significant progress in addressing this issue, they typically focus on specific r…

2025

MV-VTON: Multi-View Virtual Try-On with Diffusion Models

AAAI 2025technical

The goal of image-based virtual try-on is to generate an image of the target person naturally wearing the given clothing. However, existing methods solely focus on the frontal try-on using the frontal clothing. When the views of the clothing and person are significantly inconsistent, particularly wh…

2025

Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising

AAAI 2025technical

Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID). However, most existing BSNs are conducted with convolution layers. Although transformers have shown the potential to overcome the limitations of convolutions in many image restoration tasks,…

2024

DreamControl: Control-Based Text-to-3D Generation with 3D Self-Prior

CVPR 2024poster

3D generation has raised great attention in recent years. With the success of text-to-image diffusion models the 2D-lifting technique becomes a promising route to controllable 3D generation. However these methods tend to present inconsistent geometry which is also known as the Janus problem. We obse…

2024

Improving Image Restoration through Removing Degradations in Textual Representations

CVPR 2024poster

In this paper we introduce a new perspective for improving image restoration by removing degradation in the textual representations of a given degraded image. Intuitively restoration is much easier on text modality than image one. For example it can be easily conducted by removing degradation-relate…

2024

Learning Real-World Image De-weathering with Imperfect Supervision

AAAI 2024technical

Real-world image de-weathering aims at removing various undesirable weather-related artifacts. Owing to the impossibility of capturing image pairs concurrently, existing real-world de-weathering datasets often exhibit inconsistent illumination, position, and textures between the ground-truth images…

2024

Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

ICLR 2024poster

Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using deep neural networks for deghosting. However, the methods typically rely on suf…

2023

Spatially Adaptive Self-Supervised Learning for Real-World Image Denoising

CVPR 2023poster

Significant progress has been made in self-supervised image denoising (SSID) in the recent few years. However, most methods focus on dealing with spatially independent noise, and they have little practicality on real-world sRGB images with spatially correlated noise. Although pixel-shuffle downsampl…

2022

Self-Supervised Image Restoration with Blurry and Noisy Pairs

NeurIPS 2022accept

When taking photos under an environment with insufficient light, the exposure time and the sensor gain usually require to be carefully chosen to obtain images with satisfying visual quality. For example, the images with high ISO usually have inescapable noise, while the long-exposure ones may be blu…

2022

Self-Supervised Learning for Real-World Super-Resolution from Dual Zoomed Observations

ECCV 2022poster

"In this paper, we consider two challenging issues in reference-based super-resolution (RefSR), (i) how to choose a proper reference image, and (ii) how to learn real-world RefSR in a self-supervised manner. Particularly, we present a novel self-supervised learning approach for real-world image SR f…

2021

Learning RAW-to-sRGB Mappings With Inaccurately Aligned Supervision

ICCV 2021poster

Learning RAW-to-sRGB mapping has drawn increasing attention in recent years, wherein an input raw image is trained to imitate the target sRGB image captured by another camera. However, the severe color inconsistency makes it very challenging to generate well-aligned training pairs of input raw and t…

Cited by 52PDFcodeScholar
2018

Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels

NeurIPS 2018spotlight

Deep neural networks (DNNs) have achieved tremendous success in a variety of applications across many disciplines. Yet, their superior performance comes with the expensive cost of requiring correctly annotated large-scale datasets. Moreover, due to DNNs' rich capacity, errors in training labels can…

Cited by 3643SourcePDFScholar