Mingge Lu

Lua-LLM: Learning Unstructured-Sparsity Allocation for Large Language Models

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their extensive parameter scales pose significant challenges for practical deployment. Unstructured pruning has emerged as an effective model compression strategy with minimal performance loss, which introduces fine-grained…