Paper Info
Title
Video Super Resolution Based on Deep Convolution Neural Network With Two-Stage Motion Compensation
Abstract
In this paper, we propose methodologies to train highly accurate deep convolutional neural networks (CNNs) for video super resolution (SR). To use the inter-frame characteristic, we introduce a video SR network based on two-stage motion compensation (VSR-TMC). Firstly, the low resolution (LR) frames are aligned by the LR optical flow, and fed into a 3D-convolution network for spatial super resolution. This 3D-conv network generates the intermediate high resolution (HR) frames based on the aligned LR frames. The HR optical flow between the intermediate HR frames is further utilized to refine these HR frames as the final output. This HR optical flow could be estimated either from intermediate HR frames, or by a proposed super resolution network specifically working in the optical flow domain. Such optical flow SR network allows us to get the HR optical flow directly from the LR optical flow, which is more efficient compared to calculating HR optical flow from HR frames. Experimental results on publicly available dataset demonstrate that the VSR-TMC is significantly better compared to single image SR networks and video SR networks with LR motion compensation only. It achieves the state-of-the-art performance.
Year
DOI
Venue
2018
10.1109/ICMEW.2018.8551569
2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
Keywords
Field
DocType
Super Resolution,Convolutional Neural Network,Motion Compensation,Optical Flow,3D Convolution
Computer vision,Pattern recognition,Convolutional neural network,Computer science,Motion compensation,Artificial intelligence,Superresolution,Optical flow
Conference
ISSN
ISBN
Citations 
2330-7927
978-1-5386-4196-5
0
PageRank 
References 
Authors
0.34
6
3
Name
Order
Citations
PageRank
Haoyu Ren1507.81
El-Khamy Mostafa226428.10
Jungwon Lee389095.15