Title
Inner-Imaging Networks: Put Lenses Into Convolutional Structure
Abstract
Despite the tremendous success in computer vision, deep convolutional networks suffer from serious computation costs and redundancies. Although previous works address that by enhancing the diversities of filters, they have not considered the complementarity and the completeness of the internal convolutional structure. To respond to this problem, we propose a novel inner-imaging (InI) architecture, which allows relationships between channels to meet the above requirement. Specifically, we organize the channel signal points in groups using convolutional kernels to model both the intragroup and intergroup relationships simultaneously. A convolutional filter is a powerful tool for modeling spatial relations and organizing grouped signals, so the proposed methods map the channel signals onto a pseudoimage, like putting a lens into the internal convolution structure. Consequently, not only is the diversity of channels increased but also the complementarity and completeness can be explicitly enhanced. The proposed architecture is lightweight and easy to be implement. It provides an efficient self-organization strategy for convolutional networks to improve their performance. Extensive experiments are conducted on multiple benchmark datasets, including CIFAR, SVHN, and ImageNet. Experimental results verify the effectiveness of the InI mechanism with the most popular convolutional networks as the backbones.
Year
DOI
Venue
2022
10.1109/TCYB.2020.3034605
IEEE Transactions on Cybernetics
Keywords
DocType
Volume
Algorithms,Neural Networks, Computer
Journal
52
Issue
ISSN
Citations 
8
2168-2267
0
PageRank 
References 
Authors
0.34
27
6
Name
Order
Citations
PageRank
Yang Hu13817.61
Guihua Wen2168.69
Mingnan Luo333.06
Dan Dai433.40
Wen-Ming Cao52611.53
Zhiwen Yu66510.06