Alec Lu

You Already Have It: A Generator-Free Low-Precision DNN Training Framework Using Stochastic Rounding

"Stochastic rounding is a critical technique used in low-precision deep neural networks (DNNs) training to ensure good model accuracy. However, it requires a large number of random numbers generated on the fly. This is not a trivial task on the hardware platforms such as FPGA and ASIC. The widely us…