← Search

Gao Peng

5 accepted papers

2022

UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning

ICLR 2022poster

It is a challenging task to learn rich and multi-scale spatiotemporal semantics from high-dimensional videos, due to large local redundancy and complex global dependency between video frames. The recent advances in this research have been mainly driven by 3D convolutional neural networks and vision…

2022

Unsupervised Representation for Semantic Segmentation by Implicit Cycle-Attention Contrastive Learning

AAAI 2022technical

We study the unsupervised representation learning for the semantic segmentation task. Different from previous works that aim at providing unsupervised pre-trained backbones for segmentation models which need further supervised fine-tune, here, we focus on providing representation that is only traine…

Cited by 11SourcePDFScholar
2021

Container: Context Aggregation Networks

NeurIPS 2021poster

Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations. Recently, Transformers -- originally introduced in natural language processing -- have been increasingly adopted in computer vision. While early adopters continued to employ C…

2021

Dual-stream Network for Visual Recognition

NeurIPS 2021poster

Transformers with remarkable global representation capacities achieve competitive results for visual tasks, but fail to consider high-level local pattern information in input images. In this paper, we present a generic Dual-stream Network (DS-Net) to fully explore the representation capacity of loc…

Cited by 71SourcePDFScholar