Title
Efficient And Effective Context-Based Convolutional Entropy Modeling For Image Compression
Abstract
Precise estimation of the probabilistic structure of natural images plays an essential role in image compression. Despite the recent remarkable success of end-to-end optimized image compression, the latent codes are usually assumed to be fully statistically factorized in order to simplify entropy modeling. However, this assumption generally does not hold true and may hinder compression performance. Here we present context-based convolutional networks (CCNs) for efficient and effective entropy modeling. In particular, a 3D zigzag scanning order and a 3D code dividing technique are introduced to define proper coding contexts for parallel entropy decoding, both of which boil down to place translation-invariant binary masks on convolution filters of CCNs. We demonstrate the promise of CCNs for entropy modeling in both lossless and lossy image compression. For the former, we directly apply a CCN to the binarized representation of an image to compute the Bernoulli distribution of each code for entropy estimation. For the latter, the categorical distribution of each code is represented by a discretized mixture of Gaussian distributions, whose parameters are estimated by three CCNs. We then jointly optimize the CCN-based entropy model along with analysis and synthesis transforms for rate-distortion performance. Experiments on the Kodak and Tecnick datasets show that our methods powered by the proposed CCNs generally achieve comparable compression performance to the state-of-the-art while being much faster.
Year
DOI
Venue
2019
10.1109/TIP.2020.2985225
IEEE TRANSACTIONS ON IMAGE PROCESSING
Keywords
DocType
Volume
Image coding, Entropy, Computational modeling, Transforms, Convolutional codes, Context modeling, Convolution, Context-based convolutional networks, entropy modeling, image compression
Journal
29
Issue
ISSN
Citations 
1
1057-7149
0
PageRank 
References 
Authors
0.34
5
5
Name
Order
Citations
PageRank
Mu Li195866.10
Kede Ma277327.93
Jane You31885136.93
David Zhang42337102.40
Wangmeng Zuo53833173.11