Title
Recurrent Semantic Preserving Generation for Action Prediction
Abstract
AbstractIn this paper, we propose a recurrent semantic preserving generation (RSPG) method for action prediction. Unlike most existing methods which don’t make full use of information from partially observed sequences, we develop a generation architecture to complement the sequence of skeletons for predicting the action, which can exploit more potential information of the movement tendency. Our method learns to capture the tendency of observed sequences and complement the subsequent action with adversarial learning under some constrains, which preserves the consistency between the generation sequence and the observed sequence. By generating the subsequent action, our method can predict the action with the most probability. Moreover, the redundant generation introduces the noise and disturbs the prediction. The insufficient generation cannot exploit the potential information for improving the effect of predicting the action. Our RSPG controls the generation step in a recurrent manner for maximizing the discriminative information of actions, which can adapt to the variable length of different actions. We evaluate our method on four popular action datasets: NTU, UCF101, BIT, and UT-Interaction, and experimental results show that our method achieves very competitive performance with the state-of-the-art.
Year
DOI
Venue
2021
10.1109/TCSVT.2020.2975065
Periodicals
Keywords
DocType
Volume
Action prediction, deep reinforcement learning, generative adversarial network, skeleton based action
Journal
31
Issue
ISSN
Citations 
1
1051-8215
4
PageRank 
References 
Authors
0.40
8
4
Name
Order
Citations
PageRank
Lei Chen112853.70
Jiwen Lu23105153.88
Zhanjie Song3113.93
Jie Zhou42103190.17