NeurIPS 2020oral534 citations

High-Fidelity Generative Image Compression

Fabian Mentzer, George D Toderici, Michael Tschannen, Eirikur Agustsson

Abstract

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator architectures, training strategies, as well as perceptual losses. In contrast to previous work, i) we obtain visually pleasing reconstructions that are perceptually similar to the input, ii) we operate in a broad range of bitrates, and iii) our approach can be applied to high-resolution images. We bridge the gap between rate-distortion-perception theory and practice by evaluating our approach both quantitatively with various perceptual metrics, and with a user study. The study shows that our method is preferred to previous approaches even if they use more than 2x the bitrate.

BibTeX
@inproceedings{NEURIPS2020_8a50bae2,
 author = {Mentzer, Fabian and Toderici, George D and Tschannen, Michael and Agustsson, Eirikur},
 booktitle = {Advances in Neural Information Processing Systems},
 editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
 pages = {11913--11924},
 publisher = {Curran Associates, Inc.},
 title = {High-Fidelity Generative Image Compression},
 url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/8a50bae297807da9e97722a0b3fd8f27-Paper.pdf},
 volume = {33},
 year = {2020}
}
High-Fidelity Generative Image Compression · NeurIPS 2020