Title
Dynamic Weight Alignment for Convolutional Neural Networks.
Abstract
In this paper, we propose a method of improving Convolutional Neural Networks (CNN) by determining the optimal alignment of weights and inputs using dynamic programming. Conventional CNNs convolve learnable shared weights, or filters, across the input data. The filters use a linear matching of weights to inputs using an inner product between the filter and a window of the input. However, it is possible that there exists a more optimal alignment of weights. Thus, we propose the use of Dynamic Time Warping (DTW) to dynamically align the weights to optimized input elements. This dynamic alignment is useful for time series recognition due to the complexities of temporal relations and temporal distortions. We demonstrate the effectiveness of the proposed architecture on the Unipen online handwritten digit and character datasets, the UCI Spoken Arabic Digit dataset, and the UCI Activities of Daily Life dataset.
Year
Venue
Field
2017
arXiv: Computer Vision and Pattern Recognition
Dynamic programming,Existential quantification,Pattern recognition,Arabic,Dynamic time warping,Convolutional neural network,Computer science,Convolution,Artificial intelligence
DocType
Volume
Citations 
Journal
abs/1712.06530
0
PageRank 
References 
Authors
0.34
23
2
Name
Order
Citations
PageRank
Brian Kenji Iwana101.35
Seiichi Uchida2790105.59