Taowen Liu

Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding

LLM training is resource-intensive. Quantized training improves computational and memory efficiency but introduces quantization noise, which can hinder convergence and degrade model accuracy. Stochastic Rounding (SR) has emerged as a theoretically attractive alternative to deterministic rounding, of