lv Hanxiang

OneSparse: A Unified Framework for Sparse Activation Layers in Vision Models

Sparse activation layers, primarily Mixture-of-Experts (MoE) and memory-based modules, have become a central approach for scaling large models and are gaining traction in vision tasks. Despite conceptual similarities, these paradigms have evolved independently, hindering systematic comparison and th