← Search

Andrey Kuzmin

2 accepted papers

2023

Pruning vs Quantization: Which is Better?

NeurIPS 2023poster

Neural network pruning and quantization techniques are almost as old as neural networks themselves. However, to date, only ad-hoc comparisons between the two have been published. In this paper, we set out to answer the question of which is better: neural network quantization or pruning? By answering…

2022

FP8 Quantization: The Power of the Exponent

NeurIPS 2022accept

When quantizing neural networks for efficient inference, low-bit integers are the go-to format for efficiency. However, low-bit floating point numbers have an extra degree of freedom, assigning some bits to work on an exponential scale instead. This paper in-depth investigates this benefit of the fl…