Title
Recurrent Neural Networks With Intra-Frame Iterations For Video Deblurring
Abstract
Recurrent neural networks (RNNs) are widely used for sequential data processing. Recent state-of-the-art video deblurringmethods bank on convolutionalrecurrentneural network architectures to exploit the temporal relationship between neighboringframes. In this work, we aim to improve the accuracy of recurrentmodels by adaptingthe hidden states transferredfrom pastframes to the frame being processed so that the relationsbetween video frames could be better used. We iteratively update the hidden state via reusing RNN cell parametersbefore predictingan output deblurredframe. Since we use existing parametersto update the hidden state, our method improves accuracy withoutadditionalmodules. As the architectureremains the same regardless of iteration number fewer iterationmodels can be considered as a partial computationalpath of the models with more iterations.To take advantage of this property, we employ a stochasticmethod to optimize our iterative models better. At training time, we randomly choose the iteration number on the fly and apply a regularizationloss that favors less computation unless there are considerable reconstructiongains. We show that our method exhibits stateof-the-art video deblurringperformance while operatingin real-time speed.
Year
DOI
Venue
2019
10.1109/CVPR.2019.00829
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019)
Field
DocType
ISSN
Computer vision,Deblurring,Pattern recognition,Computer science,Recurrent neural network,Artificial intelligence,Intra-frame
Conference
1063-6919
Citations 
PageRank 
References 
6
0.41
0
Authors
3
Name
Order
Citations
PageRank
Seungjun Nah140612.44
Sanghyun Son23409.45
Kyoung Mu Lee33228153.84