Kainan Liu

GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression

Recent studies have demonstrated that many layers are functionally redundant in large language models (LLMs), enabling model compression by removing these layers to reduce inference cost. While such approaches can improve efficiency, indiscriminate layer pruning often results in significant performa