Title
Encoding Structural Similarity By Cross-Covariance Tensors For Image Classification
Abstract
In computer vision, an object can be modeled in two main ways: by explicitly measuring its characteristics in terms of feature vectors, and by capturing the relations which link an object with some exemplars, that is, in terms of similarities. In this paper, we propose a new similarity-based descriptor, dubbed structural similarity cross-covariance tensor (SS-CCT), where self-similarities come into play: Here the entity to be measured and the exemplar are regions of the same object, and their similarities are encoded in terms of cross-covariance matrices. These matrices are computed from a set of low-level feature vectors extracted from pairs of regions that cover the entire image. SS-CCT shares some similarities with the widely used covariance matrix descriptor, but extends its power focusing on structural similarities across multiple parts of an image, instead of capturing local similarities in a single region. The effectiveness of SS-CCT is tested on many diverse classification scenarios, considering objects and scenes on widely known benchmarks (Caltech-101, Caltech-256, PASCAL VOC 2007 and SenseCam). In all the cases, the results obtained demonstrate the superiority of our new descriptor against diverse competitors. Furthermore, we also reported an analysis on the reduced computational burden achieved by using and efficient implementation that takes advantage from the integral image representation.
Year
DOI
Venue
2014
10.1142/S0218001414600088
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE
Keywords
Field
DocType
Object recognition, scene classification, covariance, cross-covariance
Feature vector,Pattern recognition,Tensor,Cross-covariance,Matrix (mathematics),Artificial intelligence,Covariance matrix,Contextual image classification,Mathematics,Machine learning,Covariance,Cognitive neuroscience of visual object recognition
Journal
Volume
Issue
ISSN
28
7
0218-0014
Citations 
PageRank 
References 
2
0.37
12
Authors
5
Name
Order
Citations
PageRank
Marco San-Biagio1404.46
Samuele Martelli2314.77
Marco Crocco314914.30
M. Cristani41928109.03
Vittorio Murino53277207.20