Title
Zoom-In-To-Check: Boosting Video Interpolation Via Instance-Level Discrimination
Abstract
We propose a light-weight video frame interpolation algorithm. Our key innovation is an instance-level supervision that allows information to be learned from the high resolution version of similar objects. Our experiment shows that the proposed method can generate state-of-the-art results across different datasets, with fractional computation resources (time and memory) of competing methods.Given two image frames, a cascade network creates an intermediate frame with 1) a flow-warping module that computes coarse bi-directional optical flow and creates an interpolated image via flow-based warping, followed by 2) an image synthesis module to make fine-scale corrections. In the learning stage, object detection proposals are generated on the interpolated image. Lower resolution objects are zoomed into, and the learning algorithms using an adversarial loss trained on high-resolution objects to guide the system towards the instance-level refinement corrects details of object shape and boundaries.
Year
DOI
Venue
2018
10.1109/CVPR.2019.01246
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019)
Field
DocType
Volume
Object detection,Image warping,Pattern recognition,Computer science,Interpolation,Zoom,Boosting (machine learning),Artificial intelligence,Motion interpolation,Optical flow,Computation
Journal
abs/1812.01210
ISSN
Citations 
PageRank 
1063-6919
2
0.36
References 
Authors
0
5
Name
Order
Citations
PageRank
Liangzhe Yuan1191.96
Yibo Chen240.73
Hantian Liu320.36
Tao Kong420312.21
Jianbo Shi5102071031.66