2026
ReViT: Rotational-equivariant Vision Transformers for Neural PDE Solvers
ICML 2026oral
Physics obeys strict symmetries like rotational equivariance. However, the standard Transformer architectures widely used in physics foundation models do not enforce these constraints by construction. We introduce ReViT, a rotationally equivariant Vision Transformer framework for neural PDE solvers …