Kalin Ovtcharov

Pushing the Limits of Narrow Precision Inferencing at Cloud Scale with Microsoft Floating Point

In this paper, we explore the limits of Microsoft Floating Point (MSFP), a new class of datatypes developed for production cloud-scale inferencing on custom hardware. Through the co-evolution of hardware design and algorithms, MSFP achieves accuracy comparable to or better than industry standards Bf…