2021
A Block Minifloat Representation for Training Deep Neural Networks
ICLR 2021poster
Training Deep Neural Networks (DNN) with high efficiency can be difficult to achieve with native floating-point representations and commercially available hardware. Specialized arithmetic with custom acceleration offers perhaps the most promising alternative. Ongoing research is trending towards nar…