RDO-Q: Extremely Fine-Grained Channel-Wise Quantization via Rate-Distortion Optimization
"Allocating different bit widths to different channels and quantizing them independently bring higher quantization precision and accuracy. Most of prior works use equal bit width to quantize all layers or channels, which is sub-optimal. On the other hand, it is very challenging to explore the hyperp…