2026
Rethinking 1-bit Optimization Leveraging Pre-trained Large Language Models
ICML 2026poster
1-bit LLM quantization offers significant advantages in reducing storage and computational costs. However, existing methods typically train 1-bit LLMs from scratch, failing to fully leverage pre-trained models. This results in high training costs and notable accuracy degradation. We identify that th…