← Search

Ruixuan Yang

2 accepted papers

2026

VecAttention: Vector-wise Sparse Attention for Accelerating Long Context Inference

CVPR 2026

Long-context video understanding and generation pose a significant computational challenge for Transformer-based video models due to the quadratic complexity of self-attention. While existing sparse attention methods employ coarse-grained patterns to improve efficiency, they typically incur redundan

Cited by 0SourcecodeScholar
2026

“The Whole Is Greater than the Sum of Its Parts”: A Compatibility-Aware Multi-Teacher CoT Distillation Framework

IJCAI 2026

Chain-of-Thought (CoT) reasoning empowers Large Language Models (LLMs) with remarkable capabilities but typically requires prohibitive parameter scales. CoT distillation has emerged as a promising paradigm to transfer reasoning prowess into compact Student Models (SLMs), but existing approaches ofte

Cited by 0Scholar