← Search

Xiangyu He

16 accepted papers

2025

FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing

ICML 2025poster

Though Rectified Flows (ReFlows) with distillation offer a promising way for fast sampling, its fast inversion transforms images back to structured noise for recovery and following editing remains unsolved. This paper introduces FireFlow, an embarrassingly simple yet effective zero-shot approach tha…

2024

Z*: Zero-shot Style Transfer via Attention Reweighting

CVPR 2024poster

Despite the remarkable progress in image style transfer formulating style in the context of art is inherently subjective and challenging. In contrast to existing methods this study shows that vanilla diffusion models can directly extract style information and seamlessly integrate the generative prio…

2023

Code-Aware Cross-Program Transfer Hyperparameter Optimization

AAAI 2023technical

Hyperparameter tuning is an essential task in automatic machine learning and big data management. To accelerate tuning, many recent studies focus on augmenting BO, the primary hyperparameter tuning strategy, by transferring information from other tuning tasks. However, existing studies ignore progr…

2022

APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers

CVPR 2022poster

Federated learning frameworks typically require collaborators to share their local gradient updates of a common model instead of sharing training data to preserve privacy. However, prior works on Gradient Leakage Attacks showed that private training data can be revealed from gradients. So far almost…

Cited by 40PDFcodeScholar
2022

Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning

NeurIPS 2022accept

Freezing the pre-trained backbone has become a standard paradigm to avoid overfitting in few-shot segmentation. In this paper, we rethink the paradigm and explore a new regime: {\em fine-tuning a small part of parameters in the backbone}. We present a solution to overcome the overfitting problem, le…

2022

Towards Fully Sparse Training: Information Restoration with Spatial Similarity

AAAI 2022technical

The 2:4 structured sparsity pattern released by NVIDIA Ampere architecture, requiring four consecutive values containing at least two zeros, enables doubling math throughput for matrix multiplications. Recent works mainly focus on inference speedup via 2:4 sparsity while training acceleration has be…

Cited by 2SourcePDFScholar
2020

ProxyBNN: Learning Binarized Neural Networks via Proxy Matrices

ECCV 2020poster

Training Binarized Neural Networks (BNNs) is challenging due to the discreteness. In order to efficiently optimize BNNs through backward propagations, real-valued auxiliary variables are commonly used to accumulate gradient updates. Those auxiliary variables are then directly quantized to binary wei…

Cited by 36SourcePDFScholar
2020

Skeleton-Based Action Recognition With Shift Graph Convolutional Network

CVPR 2020oral

Action recognition with skeleton data is attracting more attention in computer vision. Recently, graph convolutional networks (GCNs), which model the human body skeletons as spatiotemporal graphs, have obtained remarkable performance. However, the computational complexity of GCN-based methods are pr…

Cited by 1008PDFScholar
2020

Soft Threshold Ternary Networks

IJCAI 2020poster

Large neural networks are difficult to deploy on mobile devices because of intensive computation and storage. To alleviate it, we study ternarization, a balance between efficiency and accuracy that quantizes both weights and activations into ternary values. In previous ternarized neural networks, a…

2020

Towards Accurate Post-training Network Quantization via Bit-Split and Stitching

ICML 2020poster

Network quantization is essential for deploying deep models to IoT devices due to its high efficiency. Most existing quantization approaches rely on the full training datasets and the time-consuming fine-tuning to retain accuracy. Post-training quantization does not have these problems, however, it…

2019

ODE-Inspired Network Design for Single Image Super-Resolution

CVPR 2019poster

Single image super-resolution, as a high dimensional structured prediction problem, aims to characterize fine-grain information given a low-resolution sample. Recent advances in convolutional neural networks are introduced into super-resolution and push forward progress in this field. Current studie…

Cited by 299PDFScholar