Title
Regularized Hierarchical Feature Learning with Non-negative Sparsity and Selectivity for Image Classification
Abstract
Recently, many deep networks are proposed to learn hierarchical image representation to replace traditional hand-designed features. To enhance the ability of the generative model to tackle discriminative computer vision tasks (e.g. image classification), we propose a hierarchical deconvolutional network with two biologically inspired properties incorporated, i.e., non-negative sparsity and selectivity. First, we propose a single layer deconvolutional model with a raw image as input, attempting to decompose the input as a weighted sum of feature maps convolving with filters. Here, the filters are the model parameters common to all the inputs, while the feature maps and the summing weights are specific to the input. The non-negative sparsity is formulated as the /i-norm regularizer on the feature map, which is used to generate feature representations for image classification. And the selectivity is forced on the filters to make different filters active different inputs, through requiring the sparsity on the summing weights specifically. The two properties are summarized into an overall cost function, which can be solved with an alternatively iterative algorithm. Then, we build multiple layer deconvolutional network by stacking the single models, where the next-layer inputs are the results of a 3D max-pooling operation on the inferred feature maps of the front layer, and train the network in a greedy layer wise scheme. Finally, we explore the feature maps of each layer to generate the image representations and input them to a SVM classifier for the classification task. Experiments on two image benchmark datasets of Caltech-101 and Caltech-256 demonstrate the encouraging performance of our model compared with other deep feature learning models as well as some hand-designed features.
Year
DOI
Venue
2014
10.1109/ICPR.2014.736
ICPR
Keywords
DocType
ISSN
regularized hierarchical feature learning,image representation,single models,feature representations,learning (artificial intelligence),feature maps,deconvolutional network,hierarchical image representation,image classification,computer vision,nonnegative sparsity,image benchmark datasets,cost function,hand designed features
Conference
1051-4651
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Bing-yuan Liu1123.36
Jing Liu2178188.09
Bai Xiao347048.67
Hanqing Lu44620291.38