Ningning CHEN

HBLLM: Wavelet-Enhanced High-Fidelity 1-Bit Quantization for LLMs

We introduce HBLLM, a wavelet-enhanced high-fidelity $1$-bit post-training quantization method for Large Language Models (LLMs). By leveraging Haar wavelet transforms to enhance expressive capacity through frequency decomposition, HBLLM significantly improves quantization fidelity while maintaining…