Oscar Castaneda

WrapNet: Neural Net Inference with Ultra-Low-Precision Arithmetic

Low-precision neural networks represent both weights and activations with few bits, drastically reducing the cost of multiplications. Meanwhile, these products are accumulated using high-precision (typically 32-bit) additions. Additions dominate the arithmetic complexity of inference in quantized (…