2018
Training Deep Neural Networks with 8-bit Floating Point Numbers
NeurIPS 2018poster
The state-of-the-art hardware platforms for training deep neural networks are moving from traditional single precision (32-bit) computations towards 16 bits of precision - in large part due to the high energy efficiency and smaller bit storage associated with using reduced-precision representations.…