2021
FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention
NeurIPS 2021poster
We propose FMMformers, a class of efficient and flexible transformers inspired by the celebrated fast multipole method (FMM) for accelerating interacting particle simulation. FMM decomposes particle-particle interaction into near-field and far-field components and then performs direct and coarse-gra…