Title
Conditional Hyper-Network for Blind Super-Resolution With Multiple Degradations
Abstract
Although the single-image super-resolution (SISR) methods have achieved great success on the single degradation, they still suffer performance drop with multiple degrading effects in real scenarios. Recently, some blind and non-blind models for multiple degradations have been explored. However, these methods usually degrade significantly for distribution shifts between the training and test data. Towards this end, we propose a novel conditional hyper-network framework for super-resolution with multiple degradations (named CMDSR), which helps the SR framework learn how to adapt to changes in the degradation distribution of input. We extract degradation prior at the task-level with the proposed ConditionNet, which will be used to adapt the parameters of the basic SR network (BaseNet). Specifically, the ConditionNet of our framework first learns the degradation prior from a support set, which is composed of a series of degraded image patches from the same task. Then the adaptive BaseNet rapidly shifts its parameters according to the conditional features. Moreover, in order to better extract degradation prior, we propose a task contrastive loss to shorten the inner-task distance and enlarge the cross-task distance between task-level features. Without predefining degradation maps, our blind framework can conduct one single parameter update to yield considerable improvement in SR results. Extensive experiments demonstrate the effectiveness of CMDSR over various blind, and even several non-blind methods. The flexible BaseNet structure also reveals that CMDSR can be a general framework for a large series of SISR models. Our code is available at https://github.com/guanghaoyin/CMDSR.
Year
DOI
Venue
2022
10.1109/TIP.2022.3176526
IEEE TRANSACTIONS ON IMAGE PROCESSING
Keywords
DocType
Volume
Degradation, Task analysis, Feature extraction, Adaptation models, Kernel, Training, Superresolution, Blind super-resolution, hyper-network, meta-learning, multi-degradation shift
Journal
31
Issue
ISSN
Citations 
1
1057-7149
0
PageRank 
References 
Authors
0.34
19
8
Name
Order
Citations
PageRank
Guanghao Yin101.01
Wei Wang200.34
Ze-Huan Yuan3389.09
Xi Li443.08
Dongdong Yu5637.07
Shouqian Sun69219.93
Tat-Seng Chua700.34
Changhu Wang8129670.36