2023
Causes and Effects of Unanticipated Numerical Deviations in Neural Network Inference Frameworks
NeurIPS 2023poster
Hardware-specific optimizations in machine learning (ML) frameworks can cause numerical deviations of inference results. Quite surprisingly, despite using a fixed trained model and fixed input data, inference results are not consistent across platforms, and sometimes not even deterministic on the sa…