2024
AMPA: Adaptive Mixed Precision Allocation for Low-Bit Integer Training
ICML 2024poster
Low-bit integer training emerges as a promising approach to mitigate the heavy burden during network training by quantizing the weights, activations, and gradients. However, existing methods cannot well achieve mixed-precision quantization for low-bit training and are commonly limited to INT8 precis…