Title
Convolutional neural network with nonlinear competitive units.
Abstract
Convolutional Neural Network (CNN) has been an important breakthrough in pattern recognition in recent years. Nevertheless, with the increase in complexity, CNN becomes more difficult to train. To alleviate the problem of training difficulties, we propose a novel nonlinear unit, called Nonlinear Competitive Unit (NCU). By comparing the elements from different network layers and selecting the larger signals element-wisely, it can not only strengthen feature propagation but also accelerate the convergence of CNN. This unit can be regarded as a feature fusion method as well as a kind of activation function. We evaluate our NCU-based models for face verification task and visual classification task on four benchmark datasets. The experimental results demonstrate the superior performance of our models over many state-of-the-art methods, which shows the advantage and potential of the NCU in networks.
Year
DOI
Venue
2018
10.1016/j.image.2017.09.011
Signal Processing: Image Communication
Keywords
Field
DocType
Nonlinear competitive unit,Feature fusion,Activation function,Face verification,Visual classification
Face verification,Convergence (routing),Computer vision,Feature fusion,Nonlinear system,Computer science,Convolutional neural network,Activation function,Artificial intelligence
Journal
Volume
ISSN
Citations 
60
0923-5965
0
PageRank 
References 
Authors
0.34
20
6
Name
Order
Citations
PageRank
Zhang-Ling Chen120.70
Jun Wang2192.61
Wen-Juan Li301.01
Nan Li440.74
Hua-Ming Wu57913.85
Da-Wei Wang603.38