Xiliang Zhu

Can Post-Training Quantization Benefit from an Additional QLoRA Integration?

Large language models (LLMs) have transformed natural language processing but pose significant challenges for real-world deployment. These models necessitate considerable computing resources, which can be costly and frequently unavailable. Model compression techniques such as quantization are often…