Chenhang He*

ScatterFormer: Efficient Voxel Transformer with Scattered Linear Attention

"Window-based transformers excel in large-scale point cloud understanding by capturing context-aware representations with affordable attention computation in a more localized manner. However, the sparse nature of point clouds leads to a significant variance in the number of voxels per window. Existi…