Title
Cross-View Gait Recognition Using Pairwise Spatial Transformer Networks
Abstract
AbstractIn this paper, we propose a pairwise spatial transformer network (PSTN) for cross-view gait recognition, which reduces unwanted feature mis-alignment due to view differences before a recognition step for better performance. The proposed PSTN is a unified CNN architecture that consists of a pairwise spatial transformer (PST) and subsequent recognition network (RN). More specifically, given a matching pair of gait features from different source and target views, the PST estimates a non-rigid deformation field to register the features in the matching pair into their intermediate view, which mitigates distortion by registration compared with the case of direct deformation from the source view to target view. The registered matching pair is then fed into the RN to output a dissimilarity score. Although registration may reduce not only intra-subject variations but also inter-subject variations, we can still achieve a good trade-off between them using a loss function designed to optimize recognition accuracy. Experiments on three publicly available gait datasets demonstrate that the proposed method yields superior performance for both verification and identification scenarios by combining any gait recognition network benchmarks with the PST.
Year
DOI
Venue
2021
10.1109/TCSVT.2020.2975671
Periodicals
Keywords
DocType
Volume
Gait recognition, Task analysis, Transforms, Probes, Measurement, Support vector machines, Databases, Pairwise spatial transformer, convolutional neural network, gait recognition, cross-view
Journal
31
Issue
ISSN
Citations 
1
1051-8215
5
PageRank 
References 
Authors
0.40
11
5
Name
Order
Citations
PageRank
C. Xu18013.87
Yasushi Makihara2101270.67
Xiang Li3528.31
Yasushi Yagi41752186.22
Jianfeng Lu5206.19