← Search

Siyuan Pan

3 accepted papers

2024

Agent Attention: On the Integration of Softmax and Linear Attention

ECCV 2024poster

"The attention module is the key component in Transformers. While the global attention mechanism offers high expressiveness, its excessive computational cost restricts its applicability in various scenarios. In this paper, we propose a novel attention paradigm, Agent Attention, to strike a favorable…

2023

Augmentation-Aware Self-Supervision for Data-Efficient GAN Training

NeurIPS 2023poster

Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs. However, the augmentation implicitly introduces undesired invari…

2022

Conditional GANs with Auxiliary Discriminative Classifier

ICML 2022spotlight

Conditional generative models aim to learn the underlying joint distribution of data and labels to achieve conditional data generation. Among them, the auxiliary classifier generative adversarial network (AC-GAN) has been widely used, but suffers from the problem of low intra-class diversity of the…