← Search

Xiuyu Sun

13 accepted papers

2023

Beyond Appearance: A Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Tasks

CVPR 2023poster

Human-centric visual tasks have attracted increasing research attention due to their widespread applications. In this paper, we aim to learn a general human representation from massive unlabeled human images which can benefit downstream human-centric tasks to the maximum extent. We call this method…

2023

DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network

CVPR 2023poster

The rapid advances in Vision Transformer (ViT) refresh the state-of-the-art performances in various vision tasks, overshadowing the conventional CNN-based models. This ignites a few recent striking-back research in the CNN world showing that pure CNN models can achieve as good performance as ViT mod…

2023

Maximizing Spatio-Temporal Entropy of Deep 3D CNNs for Efficient Video Recognition

ICLR 2023poster

3D convolution neural networks (CNNs) have been the prevailing option for video recognition. To capture the temporal information, 3D convolutions are computed along the sequences, leading to cubically growing and expensive computations. To reduce the computational cost, previous methods resort to ma…

2023

PreNAS: Preferred One-Shot Learning Towards Efficient Neural Architecture Search

ICML 2023poster

The wide application of pre-trained models is driving the trend of once-for-all training in one-shot neural architecture search (NAS). However, training within a huge sample space damages the performance of individual subnets and requires much computation to search for a optimal model. In this paper…

2022

Ada-NETS: Face Clustering via Adaptive Neighbour Discovery in the Structure Space

ICLR 2022poster

Face clustering has attracted rising research interest recently to take advantage of massive amounts of face images on the web. State-of-the-art performance has been achieved by Graph Convolutional Networks (GCN) due to their powerful representation capacity. However, existing GCN-based methods buil…

2022

Entroformer: A Transformer-based Entropy Model for Learned Image Compression

ICLR 2022poster

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon convolutional neural networks which are inefficient in captur…

Cited by 169SourcePDFScholar
2022

Entropy-Driven Mixed-Precision Quantization for Deep Network Design

NeurIPS 2022accept

Deploying deep convolutional neural networks on Internet-of-Things (IoT) devices is challenging due to the limited computational resources, such as limited SRAM memory and Flash storage. Previous works re-design a small network for IoT devices, and then compress the network size by mixed-precision q…

2022

GiraffeDet: A Heavy-Neck Paradigm for Object Detection

ICLR 2022poster

In conventional object detection frameworks, a backbone body inherited from image recognition models extracts deep latent features and then a neck module fuses these latent features to capture information at different scales. As the resolution in object detection is much larger than in image recogni…

2022

Jmpnet: Joint Motion Prediction for Learning-Based Video Compression

ICASSP 2022accepted

In recent years, more attention is attracted by learning-based approaches in the field of video compression. Recent methods of this kind normally consist of three major components: intra-frame network, motion prediction network, and residual network, among which the motion prediction part is particu…

Cited by 0SourceScholar
2022

MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection

ICML 2022spotlight

In object detection, the detection backbone consumes more than half of the overall inference cost. Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Architecture Search (NAS). However, existing NAS methods for object detection require hundr…

2022

Robust Graph Structure Learning via Multiple Statistical Tests

NeurIPS 2022accept

Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to construct a graph among images is to treat each image as a node and…

2021

Learning Accurate Entropy Model with Global Reference for Image Compression

ICLR 2021poster

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyperprior with local context in the entropy estimation function. This greatly limits their performance due to the absence…

Cited by 86SourcePDFScholar
2021

Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition

ICCV 2021poster

Accuracy predictor is a key component in Neural Architecture Search (NAS) for ranking architectures. Building a high-quality accuracy predictor usually costs enormous computation. To address this issue, instead of using an accuracy predictor, we propose a novel zero-shot index dubbed Zen-Score to ra…

Cited by 184PDFcodeScholar