Zhixia Liu

RaaS: Reasoning-Aware Attention Sparsity for Efficient LLM Reasoning

Large Language Models (LLMs) have demonstrated strong capabilities across various domains, with recent advancements in challenging reasoning tasks such as mathematics and programming. However, solving reasoning tasks often requires an LLM to generate long sequences, incurring O(N) time and memory co…