Title
Convolutional Neural Networks for Omnidirectional Image Quality Assessment: A Benchmark
Abstract
In this paper, we conduct an extensive study on the use of pre-trained convolutional neural networks (CNNs) for omnidirectional image quality assessment (IQA). To cope with the lack of available IQA databases, transfer learning from seven pre-trained CNN models is investigated over retraining on standard 2D databases. In addition, we explore the influence of various image representations and training strategies on the model’s performance. A comparison of the use of projected versus radial content, and multichannel CNN versus patch-wise training is also covered. The experimental results on two publicly available databases are used to draw conclusions about which strategy best fits the visual quality prediction and at which computational cost. The analysis shows that retraining CNN models on 2D IQA databases improves the prediction accuracy. The latter and the required computational time are found to be significantly affected by the training strategy. Cross-database evaluations demonstrate that the nature and variety of the content impact the generalization ability of the models. Finally, we show that conclusions coming from other image processing communities may not hold for IQA. The provided discussion shall provide insights and recommendations when using pre-trained CNNs for omnidirectional IQA.
Year
DOI
Venue
2022
10.1109/TCSVT.2022.3181235
IEEE Transactions on Circuits and Systems for Video Technology
Keywords
DocType
Volume
Benchmark,convolutional neural networks,omnidirectional images,image quality assessment
Journal
32
Issue
ISSN
Citations 
11
1051-8215
0
PageRank 
References 
Authors
0.34
25
3
Name
Order
Citations
PageRank
Abderrezzaq Sendjasni111.70
Mohamed-Chaker Larabi234743.48
Faouzi Alaya Cheikh316838.47