Paper Info
Title
Inter-frame video image generation based on spatial continuity generative adversarial networks
Abstract
This paper proposes a method for generating inter-frame video images based on spatial continuity generative adversarial networks (SC-GANs) to smooth the playing of low-frame rate videos and to clarify blurry image edges caused by the use of traditional methods to improve the video frame rate. Firstly, the auto-encoder is used as a discriminator and Wasserstein distance is applied to represent the difference between the loss distribution of the real sample and the generated sample, instead of the typical method of generative adversarial networks to directly match data distribution. Secondly, the hyperparameter between generator and discriminator is used to stabilize the training process, which effectively prevents the model from collapsing. Finally, taking advantage of the spatial continuity of the image features of continuous video frames, an optimal value between two consecutive frames is found by Adam and then mapped to the image space to generate inter-frame images. In order to illustrate the authenticity of the generated inter-frame images, PSNR and SSIM are adopted to evaluate the inter-frame images, and the results show that the generated inter-frame images have a high degree of authenticity. The feasibility and validity of the proposed method based on SC-GAN are also verified.
Year
DOI
Venue
2019
10.1007/s11760-019-01499-0
Signal, Image and Video Processing
Keywords
Field
DocType
GAN, Adversarial training, Spatial continuity, Adam, Inter-frame image generation
Computer vision,Image generation,Discriminator,Pattern recognition,Hyperparameter,Feature (computer vision),Artificial intelligence,Inter frame,Frame rate,Generative grammar,Mathematics,Adversarial system
Journal
Volume
Issue
ISSN
13
8
1863-1703
Citations 
PageRank 
References 
0
0.34
9
Authors
3
Name
Order
Citations
PageRank
Tao Zhang122069.03
Peipei Jiang200.34
Meng Zhang300.68