Semyon Savkin

2 accepted papers

2026

WaterSIC: information-theoretically (near) optimal linear layer quantization

Egor Lifar, Semyon Savkin, Or Ordentlich, Yury Polyanskiy

ICML 2026spotlight

This paper considers the problem of converting a given dense linear layer into a low-precision version. The tradeoff between minimizing description length and discrepancy introduced at the output of the layer is analyzed information theoretically (IT). It is shown that the popular GPTQ algorithm may…

Cited by 0 Source ↗Scholar ↗

2025

NestQuant: nested lattice quantization for matrix products and LLMs

Semyon Savkin, Eitan Porat, Or Ordentlich, Yury Polyanskiy

ICML 2025poster

Post-training quantization (PTQ) has emerged as a critical technique for efficient deployment of large language models (LLMs). This work proposes NestQuant, a novel PTQ scheme for weights and activations that is based on self-similar nested lattices. Recent works have mathematically shown such quan…

Cited by 0 Source ↗PDF ↗Scholar ↗