Title
A Perception-Inspired Deep Learning Framework for Predicting Perceptual Texture Similarity
Abstract
Similarity learning plays a fundamental role in the fields of multimedia retrieval and pattern recognition. Prediction of perceptual similarity is a challenging task as in most cases we lack human labeled ground-truth data and robust models to mimic human visual perception. Although in the literature, some studies have been dedicated to similarity learning, they mainly focus on the evaluation of whether or not two images are similar, rather than prediction of perceptual similarity which is consistent with human perception. Inspired by the human visual perception mechanism, we here propose a novel framework in order to predict perceptual similarity between two texture images. Our proposed framework is built on the top of Convolutional Neural Networks (CNNs). The proposed framework considers both powerful features and perceptual characteristics of contours extracted from the images. The similarity value is computed by aggregating resemblances between the corresponding convolutional layer activations of the two texture maps. Experimental results show that the predicted similarity values are consistent with the human-perceived similarity data.
Year
DOI
Venue
2020
10.1109/TCSVT.2019.2944569
IEEE Transactions on Circuits and Systems for Video Technology
Keywords
DocType
Volume
Visualization,Feature extraction,Visual perception,Pattern recognition,Task analysis,Convolutional neural networks
Journal
30
Issue
ISSN
Citations 
10
1051-8215
1
PageRank 
References 
Authors
0.35
8
6
Name
Order
Citations
PageRank
Ying Gao111.03
Yanhai Gan222.06
Lin Qi3278.68
Huiyu Zhou410.35
Xinghui Dong5347.06
Junyu Dong69923.43