Name
Abstract | ||
|---|---|---|
Video restoration tasks, including super-resolution, de blurring, etc, are drawing increasing attention in the computer vision community. A challenging benchmark named REDS is released in the NTIREI9 Challenge. This new benchmark challenges existing methods from two aspects: (1) how to align multiple frames given large motions, and (2) how to effectively fuse different frames with diverse motion and blur. In this work, we propose a novel Video Restoration framework with Enhanced Deformable convolutions, termed EDVR, to address these challenges. First, to handle large motions, we devise a Pyramid, Cascading and Deformable (PCD) alignment module, in which frame alignment is done at the feature level using deformable convolutions in a coarse-to-fine manner. Second, we propose a Temporal and Spatial Attention (TSA) fusion module, in which attention is applied both temporally and spatially, so as to emphasize important features for subsequent restoration. Thanks to these modules, our EDVR wins the champions and outperforms the second place by a large margin in all four tracks in the NTIREI9 video restoration and enhancement challenges. EDVR also demonstrates superior performance to state-of-the-art published methods on video super-resolution and deblurring. The code is available at https://github.com/xinntao/EDVR. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/CVPRW.2019.00247 | IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops |
Field | DocType | Volume |
Pattern recognition,Deblurring,Computer science,Convolution,Artificial intelligence,Pyramid,Fuse (electrical),Video restoration | Journal | abs/1905.02716 |
ISSN | Citations | PageRank |
2160-7508 | 26 | 0.66 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xintao Wang | 1 | 144 | 9.14 |
| Kelvin C. K. Chan | 2 | 32 | 2.74 |
| Ke Yu | 3 | 29 | 2.40 |
| Chao Dong | 4 | 2064 | 80.72 |
| Chen Change Loy | 5 | 4484 | 178.56 |