Abstract | ||
---|---|---|
Convolutional Neural Network (CNN) has been an important breakthrough in pattern recognition in recent years. Nevertheless, with the increase in complexity, CNN becomes more difficult to train. To alleviate the problem of training difficulties, we propose a novel nonlinear unit, called Nonlinear Competitive Unit (NCU). By comparing the elements from different network layers and selecting the larger signals element-wisely, it can not only strengthen feature propagation but also accelerate the convergence of CNN. This unit can be regarded as a feature fusion method as well as a kind of activation function. We evaluate our NCU-based models for face verification task and visual classification task on four benchmark datasets. The experimental results demonstrate the superior performance of our models over many state-of-the-art methods, which shows the advantage and potential of the NCU in networks. |
Year | DOI | Venue |
---|---|---|
2018 | 10.1016/j.image.2017.09.011 | Signal Processing: Image Communication |
Keywords | Field | DocType |
Nonlinear competitive unit,Feature fusion,Activation function,Face verification,Visual classification | Face verification,Convergence (routing),Computer vision,Feature fusion,Nonlinear system,Computer science,Convolutional neural network,Activation function,Artificial intelligence | Journal |
Volume | ISSN | Citations |
60 | 0923-5965 | 0 |
PageRank | References | Authors |
0.34 | 20 | 6 |
Name | Order | Citations | PageRank |
---|---|---|---|
Zhang-Ling Chen | 1 | 2 | 0.70 |
Jun Wang | 2 | 19 | 2.61 |
Wen-Juan Li | 3 | 0 | 1.01 |
Nan Li | 4 | 4 | 0.74 |
Hua-Ming Wu | 5 | 79 | 13.85 |
Da-Wei Wang | 6 | 0 | 3.38 |