Qianli Liu

TwinQuant: Learnable Subspace Decomposition for 4-Bit LLM Quantization

4-bit quantization reduces the memory footprint and latency of large language model inference, but its aggressive precision reduction can severely degrade accuracy. Prior methods address this by decomposing each weight matrix into two components (e.g., via singular value decomposition) and quantizin…