2025
CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs
ICASSP 2025accepted
Large language models have achieved notable success across various domains, yet efficient inference is still limited by the quadratic computation complexity of the attention mechanism. The inference consists of prefilling and decoding phases. Although several attempts have been made to accelerate de…