Title
CovNN: A Covariance Neural Network Extended from CNN
Abstract
Convolutional neural networks (CNNs) show commendable performance in computer vision, approaching high accuracy in a broad number of application domains. However, the training process of feature kernels in CNNs is easily affected by illumination intensity and feature interaction, which leads to over-fitting. In this paper, we propose a covariance neural network (CovNN), which replaces the original convolutional operation with our covariance algorithm, to make the learned kernels more robust to different illumination conditions and irrelevant features. This covariance layer uses the 3D covariance between all the input feature maps and the corresponding group of kernels by sliding window method, and regularizes them without additional parameters. Moreover, the covariance layer can be seamlessly transplanted to a variety of neural network architectures extended from CNNs (e.g., ResNet, Faster R-CNN). We evaluate the proposed CovNN on several popular datasets for image recognition (MNIST, Fashion-MNIST, CIFAR 10 and AR) and classification of organs (Abdominal Ultrasound Dataset). Experimental results demonstrate that CovNN achieves significant improvements over the state-of-the-art on most of them.
Year
DOI
Venue
2018
10.1109/UV.2018.8642150
2018 4th International Conference on Universal Village (UV)
Keywords
Field
DocType
Abdominal ultrosound,covariance,convolutional neural networks(CNNs),image recognition
MNIST database,Sliding window protocol,Pattern recognition,Computer science,Convolutional neural network,Artificial intelligence,Residual neural network,Artificial neural network,Covariance
Conference
ISBN
Citations 
PageRank 
978-1-5386-5197-1
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Yue Shen1196.48
Tianyou Zheng200.68
Dandan Li3277.99
Zicai Wang4306.84