← Search

Zhiyu Zhu

23 accepted papers

2026

Consistency Geodesic Bridge: Image Restoration with Pretrained Diffusion Models

ICLR 2026poster

Bridge diffusion models have shown great promise in image restoration by constructing a direct path from degraded to clean images. However, they often rely on predefined, high-action trajectories, which limits both sampling efficiency and final restoration quality. To address this, we propose a Cons…

Cited by 0SourcecodeScholar
2026

Faithfulness Under the Distribution: A New Look at Attribution Evaluation

ICLR 2026poster

Evaluating the faithfulness of attribution methods remains an open challenge. Standard metrics such as Insertion and Deletion Scores rely on heuristic input perturbations (e.g., zeroing pixels), which often push samples out of the data distribution (OOD). This can distort model behavior and lead to…

Cited by 0SourceScholar
2026

Optimal Look-back Horizon for Time Series Forecasting in Federated Learning

AAAI 2026technical

Selecting an appropriate look-back horizon remains a fundamental challenge in time series forecasting (TSF), particularly in federated learning scenarios where data is decentralized, heterogeneous, and often non-independent. While recent work has explored horizon selection by preserving forecasting-

Cited by 0SourcePDFScholar
2026

Scaling Dense Event-Stream Pretraining from Visual Foundation Models

CVPR 2026

Learning versatile, fine-grained representations from irregular event streams is pivotal yet nontrivial, primarily due to the heavy annotation that hinders scalability in dataset size, semantic richness, and application scope. To mitigate this dilemma, we launch a novel self-supervised pretraining m

Cited by 0SourcecodeScholar
2025

Acc3D: Accelerating Single Image to 3D Diffusion Models via Edge Consistency Guided Score Distillation

CVPR 2025poster

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the learning of score function in states of random noise. To th…

Cited by 0SourcePDFScholar
2025

Improving Adversarial Transferability via Decision Boundary Adaptation

UAI 2025

Black-box attacks play a pivotal role in adversarial attacks. However, existing approaches often focus predominantly on attacking from a data-centric perspective, neglecting crucial aspects of the models. To address this issue, we propose a novel approach in this paper, coined Decision Boundary Adap

2025

NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer

ICLR 2025poster

By harnessing the potent generative capabilities of pre-trained large video diffusion models, we propose a new novel view synthesis paradigm that operates without the need for training. The proposed method adaptively modulates the diffusion sampling process with the given views to enable the creatio…

2025

Narrowing Information Bottleneck Theory for Multimodal Image-Text Representations Interpretability

ICLR 2025poster

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex associations between images and text. Despite these advanceme…

2025

ParaSolver: A Hierarchical Parallel Integral Solver for Diffusion Models

ICLR 2025poster

This paper explores the challenge of accelerating the sequential inference process of Diffusion Probabilistic Models (DPMs). We tackle this critical issue from a dynamic systems perspective, in which the inherent sequential nature is transformed into a parallel sampling process. Specifically, we pro…

2025

Splitting & Integrating: Out-of-Distribution Detection via Adversarial Gradient Attribution

ICML 2025poster

Out-of-distribution (OOD) detection is essential for enhancing the robustness and security of deep learning models in unknown and dynamic data environments. Gradient-based OOD detection methods, such as GAIA, analyse the explanation pattern representations of in-distribution (ID) and OOD samples by…

2024

AttEXplore: Attribution for Explanation with model parameters eXploration

ICLR 2024poster

Due to the real-world noise and human-added perturbations, attaining the trustworthiness of deep neural networks (DNNs) is a challenging task. Therefore, it becomes essential to offer explanations for the decisions made by these non-linear and complex parameterized models. Attribution methods are pr…

2024

E-Motion: Future Motion Simulation via Event Sequence Diffusion

NeurIPS 2024poster

Forecasting a typical object's future motion is a critical task for interpreting and interacting with dynamic environments in computer vision. Event-based sensors, which could capture changes in the scene with exceptional temporal granularity, may potentially offer a unique opportunity to predict fu…

2024

Enhancing Transferable Adversarial Attacks on Vision Transformers through Gradient Normalization Scaling and High-Frequency Adaptation

ICLR 2024poster

Vision Transformers (ViTs) have been widely used in various domains. Similar to Convolutional Neural Networks (CNNs), ViTs are prone to the impacts of adversarial samples, raising security concerns in real-world applications. As one of the most effective black-box attack methods, transferable attack…

2024

Iterative Search Attribution for Deep Neural Networks

ICML 2024poster

Deep neural networks (DNNs) have achieved state-of-the-art performance across various applications. However, ensuring the reliability and trustworthiness of DNNs requires enhanced interpretability of model inputs and outputs. As an effective means of Explainable Artificial Intelligence (XAI) researc…

2024

MFABA: A More Faithful and Accelerated Boundary-Based Attribution Method for Deep Neural Networks

AAAI 2024technical

To better understand the output of deep neural networks (DNN), attribution based methods have been an important approach for model interpretability, which assign a score for each input dimension to indicate its importance towards the model outcome. Notably, the attribution methods use the ax- ioms o…

2024

PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preference

NeurIPS 2024poster

In this paper, we make the first attempt to align diffusion models for image inpainting with human aesthetic standards via a reinforcement learning framework, significantly improving the quality and visual appeal of inpainted images. Specifically, instead of directly measuring the divergence with pa…

2024

Segment Any Event Streams via Weighted Adaptation of Pivotal Tokens

CVPR 2024poster

In this paper we delve into the nuanced challenge of tailoring the Segment Anything Models (SAMs) for integration with event data with the overarching objective of attaining robust and universal object segmentation within the event-centric domain. One pivotal issue at the heart of this endeavor is t…

2023

Cross-Modal Orthogonal High-Rank Augmentation for RGB-Event Transformer-Trackers

ICCV 2023poster

This paper addresses the problem of cross-modal object tracking from RGB videos and event data. Rather than constructing a complex cross-modal fusion network, we explore the great potential of a pre-trained vision Transformer (ViT). Particularly, we delicately investigate plug-and-play training augm…

Cited by 36PDFcodeScholar
2023

Global Structure-Aware Diffusion Process for Low-light Image Enhancement

NeurIPS 2023poster

This paper studies a diffusion-based framework to address the low-light image enhancement problem. To harness the capabilities of diffusion models, we delve into this intricate process and advocate for the regularization of its inherent ODE-trajectory. To be specific, inspired by the recent research…

2022

Learning Graph-embedded Key-event Back-tracing for Object Tracking in Event Clouds

NeurIPS 2022accept

Event data-based object tracking is attracting attention increasingly. Unfortunately, the unusual data structure caused by the unique sensing mechanism poses great challenges in designing downstream algorithms. To tackle such challenges, existing methods usually re-organize raw event data (or event…

2021

CorrNet3D: Unsupervised End-to-End Learning of Dense Correspondence for 3D Point Clouds

CVPR 2021poster

Motivated by the intuition that one can transform two aligned point clouds to each other more easily and meaningfully than a misaligned pair, we propose CorrNet3D -the first unsupervised and end-to-end deep learning-based framework - to drive the learning of dense correspondence between 3D shapes by…

Cited by 97PDFcodeScholar
2021

Semantic-Embedded Unsupervised Spectral Reconstruction From Single RGB Images in the Wild

ICCV 2021poster

This paper investigates the problem of reconstructing hyperspectral (HS) images from single RGB images captured by commercial cameras, without using paired HS and RGB images during training. To tackle this challenge, we propose a new lightweight and end-to-end learning-based framework. Specifically,…

Cited by 29PDFcodeScholar