Minrui Jiang

Toward Safe Quantization-Aware Fine-tuning: Understanding and Mitigating Safety Alignment Degradation

Large language models (LLMs) are increasingly adapted to downstream tasks in resource-constrained scenarios, making quantization-aware fine-tuning (QAF) a common practice for practical deployment. However, we find that quantized LLMs are substantially more vulnerable to safety alignment degradation …