2026
1-Bit Wonder: Improving QAT Performance in the Low-Bit Regime through K-Means Quantization
ICML 2026poster
Quantization-aware training (QAT) is an effective method to drastically reduce the memory footprint of LLMs while keeping performance degradation at an acceptable level. However, the optimal choice of quantization format and bit-width presents a challenge in practice. The full design space of quanti…