Chengxi Min

Compass-RoPE: Isotropic Rotary Position Embeddings for Vision Transformers

Recent works introduce Rotary Position Embeddings (RoPE) into vision transformers (ViTs) to enhance their extrapolation capability, i.e., maintaining performance when inference is conducted on higher resolution images. RoPE encodes positions via rotating phases whose change is controlled by frequenc…