AIConfPaper
← Search

Qifeng Liu*

2 accepted papers

2024

AttnZero: Efficient Attention Discovery for Vision Transformers

Lujun Li, Zimian Wei*, Peijie Dong, Wenhan Luo, Wei Xue, Qifeng Liu* +1
ECCV 2024poster

"In this paper, we present AttnZero, the first framework for automatically discovering efficient attention modules tailored for Vision Transformers (ViTs). While traditional self-attention in ViTs suffers from quadratic computation complexity, linear attention offers a more efficient alternative wit…

Cited by 6Source ↗PDF ↗code ↗Scholar ↗
2024

Auto-GAS: Automated Proxy Discovery for Training-free Generative Architecture Search

Lujun Li, Haosen Sun, Shiwen Li, Peijie Dong, Wenhan Luo, Wei Xue +2
ECCV 2024poster

"In this paper, we introduce Auto-GAS, the first training-free Generative Architecture Search (GAS) framework enabled by an auto-discovered proxy. Generative models like Generative Adversarial Networks (GANs) are now widely used in many real-time applications. Previous GAS methods use differentiable…

Cited by 9Source ↗PDF ↗code ↗Scholar ↗