Title
A graph convolutional neural network model with Fisher vector encoding and channel-wise spatial-temporal aggregation for skeleton-based action recognition
Abstract
Skeleton-based action recognition is an inspired yet challenging task in computer vision. Recently, the latest graph convolutional network (GCN), which generalises well-established convolutional neural networks to non-Euclidean structures, is proven to be highly successful for action recognition from body skeleton data. However, the GCN architecture has not been fully studied. In this work, a Fisher vector (FV) encoding based GCN architecture (FV-GCN) is proposed, which exceeds the limitations of existing GCN-based methods by combining the GCN model with FV encoding. A channel-wise spatial-temporal aggregation function to preserve spatial-temporal information in the whole action clip and integrate it into the FV-GCN architecture is also presented. Since FV is different from the GCN structure, this hybrid architecture that incorporates the advantages of both algorithms can discover complementary information of feature representation effectively. On two challenging human action datasets, kinetics, and NTU-RGBD, improved performance is demonstrated over the baseline method, and the FV-GCN is better or comparable to some state-of-the-art methods.
Year
DOI
Venue
2022
10.1049/ipr2.12422
IET IMAGE PROCESSING
DocType
Volume
Issue
Journal
16
5
ISSN
Citations 
PageRank 
1751-9659
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Jun Tang100.34
Yanjiang Wang2158.65
Sichao Fu392.96
Bao-Di Liu416627.34
WeiFeng Liu55911.72