← Search

Dixi Yao

2 accepted papers

2024

Permutation Equivariance of Transformers and Its Applications

CVPR 2024poster

Revolutionizing the field of deep learning Transformer-based models have achieved remarkable performance in many tasks. Recent research has recognized these models are robust to shuffling but are limited to inter-token permutation in the forward propagation. In this work we propose our definition of…