← Search

Zejia Fan

3 accepted papers

2022

On the Connection between Local Attention and Dynamic Depth-wise Convolution

ICLR 2022spotlight

Vision Transformer (ViT) attains state-of-the-art performance in visual recognition, and the variant, Local Vision Transformer, makes further improvements. The major component in Local Vision Transformer, local attention, performs the attention separately over small local windows. We rephrase local…

2022

Self-Learned Video Super-Resolution with Augmented Spatial and Temporal Context

ICASSP 2022accepted

Video super-resolution methods typically rely on paired training data, in which the low-resolution frames are usually synthetically generated under predetermined degradation conditions (e.g., Bicubic downsampling). However, in real applications, it is labor-consuming and expensive to obtain this kin…

Cited by 0SourceScholar
2021

Conditional DETR for Fast Training Convergence

ICCV 2021poster

The recently-developed DETR approach applies the transformer encoder and decoder architecture to object detection and achieves promising performance. In this paper, we handle the critical issue, slow training convergence, and present a conditional cross-attention mechanism for fast DETR training. Ou…

Cited by 829PDFcodeScholar