2026
Platonic Transformers: A Solid Choice For Equivariance
Mohammad Mohaiminul Islam, Rishabh Anand, David Wessels, Friso de Kruiff, Thijs Kuipers, ZHITAO YING +4
ICML 2026poster
While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and flexibility that make Transformers so effective through complex, computationally intensive designs. We introduce the Pl…