Title
Improved image classification with 4D light-field and interleaved convolutional neural network
Abstract
Image classification is a well-studied problem. However, there remains challenges for some special categories of images. This paper proposes a new deep convolutional neural network to improve image classification using extra light-field angular information. The proposed network model employs transfer learning by replacing the fully connected layer of a VGG network with a set of interleaved spatial-angular filters. The resulting model takes advantage of both the spatial and angular information of light-field images (LFIs), thus providing more accurate classification performance over traditional models. To evaluate the proposed network model, we established a light-field image dataset, currently consisting of 560 captured LFIs, which have been divided into 11 labeled categories. Based on this dataset, our experimental results show that the proposed LFI model yields an average of 92% classification accuracy as oppose to 84% from the model using traditional 2D images and 85% from the model using stereo pair images. In particular, on classifying challenging objects such as the “screen” images, the proposed LFI model demonstrated to have significant improvement of 16% and 12% respectively over the 2D image model and the stereo image model.
Year
DOI
Venue
2019
10.1007/s11042-018-6597-x
Multimedia Tools and Applications
Keywords
Field
DocType
Light field image, Image classification, Convolutional neural network
Computer vision,Pattern recognition,Convolutional neural network,Computer science,Transfer of learning,Light field,Artificial intelligence,Contextual image classification,Network model,Stereo image
Journal
Volume
Issue
ISSN
78.0
20
1573-7721
Citations 
PageRank 
References 
0
0.34
14
Authors
6
Name
Order
Citations
PageRank
Zhicheng Lu101.69
Henry Wing Fung Yeung2243.01
Qiang Qu300.34
Yuk Ying Chung421125.47
Xiaoming Chen530128.67
Zhibo Chen627044.69