← Search

Guiming Xie

2 accepted papers

2025

CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs

ICASSP 2025accepted

Large language models have achieved notable success across various domains, yet efficient inference is still limited by the quadratic computation complexity of the attention mechanism. The inference consists of prefilling and decoding phases. Although several attempts have been made to accelerate de…

Cited by 0SourceScholar
2025

Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models

ICLR 2025poster

Large Language Models (LLMs) have significantly advanced natural language processing with exceptional task generalization capabilities. Low-Rank Adaption (LoRA) offers a cost-effective fine-tuning solution, freezing the original model parameters and training only lightweight, low-rank adapter matric…