Title
Adaptive Hierarchical Motion-Focused Model for Video Prediction.
Abstract
Video prediction is a promising task in computer vision for many real-world applications and worth exploring. Most existing methods generate new frames based on appearance features with few constrain, which results in blurry predictions. Recently, some motion-focused methods are proposed to alleviate the problem. However, it's difficult to capture the object motions from a video sequence and apply the learned motions to appearance, due to variety and complexity of real-world motions. In this paper, an adaptive hierarchical motion-focused model is introduced to predict realistic future frames. This model takes advantage of hierarchical motion modeling and adaptive transformation strategy, which can achieve better motion understanding and applying. We train our model end to end and employ the popular adversarial training to improve the quality of generations. Experiments on two challenging datasets: Penn Action and UCF101, demonstrate that the proposed model is effective and competitive with outstanding approaches.
Year
DOI
Venue
2018
10.1007/978-3-030-00776-8_53
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I
Keywords
Field
DocType
Video prediction,Motion-focused model,Hierarchical motion modeling,Adaptive transformation
Computer vision,End-to-end principle,Computer science,Artificial intelligence,Motion modeling,Machine learning
Conference
Volume
ISSN
Citations 
11164
0302-9743
0
PageRank 
References 
Authors
0.34
8
4
Name
Order
Citations
PageRank
Min Tang162351.33
Wang Wenmin28819.53
Chen, xiongtao3203.41
Yifeng He436032.59