Title
Online Meta Adaptation for Variable-Rate Learned Image Compression
Abstract
This work addresses two major issues of end-to-end learned image compression (LIC) based on deep neural networks: variable-rate learning where separate networks are required to generate compressed images with varying qualities, and the train-test mismatch between differentiable approximate quantization and true hard quantization. We introduce an online meta-learning (OML) setting for LIC, which combines ideas from meta learning and online learning in the conditional variational auto-encoder (CVAE) framework. By treating the conditional variables as meta parameters and treating the generated conditional features as meta priors, the desired reconstruction can be controlled by the meta parameters to accommodate compression with variable qualities. The online learning framework is used to update the meta parameters so that the conditional reconstruction is adaptively tuned for the current image. Through the OML mechanism, the meta parameters can be effectively updated through SGD. The conditional reconstruction is directly based on the quantized latent representation in the decoder network, and therefore helps to bridge the gap between the training estimation and true quantized latent distribution. Experiments demonstrate that our OML approach can be flexibly applied to different state-of-the-art LIC methods to achieve additional performance improvements with little computation and transmission overhead.
Year
DOI
Venue
2022
10.1109/CVPRW56347.2022.00065
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Keywords
DocType
Volume
conditional reconstruction,online learning framework,variable qualities,meta parameters,conditional variational auto-encoder framework,online meta-learning,differentiable approximate quantization,compressed images,variable-rate learning,deep neural networks,end-to-end learned image compression,online meta adaptation
Conference
2022
Issue
ISSN
ISBN
1
2160-7508
978-1-6654-8740-5
Citations 
PageRank 
References 
0
0.34
5
Authors
4
Name
Order
Citations
PageRank
Wei Jiang121.09
Wei Wang200.34
Songnan Li321.41
shan liu49649.62