BaWA: Automatic Optimizing Pruning Metric for Large Language Models with Balanced Weight and Activation
One-shot post-training pruning enhances the deployment of billion-scale large language models (LLMs), with the pruning metric playing a pivotal role in determining which weights to remove. However, existing metrics underperform due to their reliance on a simple symbolic combination of weights and ac…