← Search

Zhiyu Yao

3 accepted papers

2024

Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers

ICML 2024poster

Vision Transformers (ViTs) excel in computer vision tasks due to their ability to capture global context among tokens. However, their quadratic complexity $\mathcal{O}(N^2D)$ in terms of token number $N$ and feature dimension $D$ limits practical use on mobile devices, necessitating more mobile-frie…

2021

MotionRNN: A Flexible Model for Video Prediction With Spacetime-Varying Motions

CVPR 2021poster

This paper tackles video prediction from a new dimension of predicting spacetime-varying motions that are incessantly changing across both space and time. Prior methods mainly capture the temporal state transitions but overlook the complex spatiotemporal variations of the motion itself, making them…

Cited by 197PDFcodeScholar
2020

Unsupervised Transfer Learning for Spatiotemporal Predictive Networks

ICML 2020poster

This paper explores a new research problem of unsupervised transfer learning across multiple spatiotemporal prediction tasks. Unlike most existing transfer learning methods that focus on fixing the discrepancy between supervised tasks, we study how to transfer knowledge from a zoo of unsupervisedly…