Title
Real-Time Optical Flow Estimation Using Multiple Frame-Straddling Intervals
Abstract
In this paper, we propose a novel method for accurate optical flow estimation in real time for both high-speed and low-speed moving objects based on High-Frame-Rate (HFR) videos. We introduce a multiframe-straddling function to select several pairs of images with different frame intervals from an HFR image sequence even when the estimated optical flow is required to output at standard video rates (NTSC at 30 fps and PAL at 25 fps). The multiframe-straddling function can remarkably improve the measurable range of velocities in optical flow estimation without heavy computation by adaptively selecting a small frame interval for high-speed objects and a large frame interval for low-speed objects. On the basis of the relationship between the frame intervals and the accuracies of the optical flows estimated by the Lucas-Kanade method, we devise a method to determine multiple frame intervals in optical flow estimation and select an optimal frame interval from these intervals according to the amplitude of the estimated optical flow. Our method was implemented using software on a high-speed vision platform, IDP Express. The estimated optical flows were accurately outputted at intervals of 40 ms in real time by using three pairs of 512 x 512 images; these images were selected by frame-straddling a 2000-fps video with intervals of 0.5, 1.5, and 5 ms. Several experiments were performed for high-speed movements to verify that our method can remarkably improve the measurable range of velocities in optical flow estimation, compared to optical flows estimated for 25-fps videos with the Lucas-Kanade method.
Year
DOI
Venue
2012
10.20965/jrm.2012.p0686
JOURNAL OF ROBOTICS AND MECHATRONICS
Keywords
Field
DocType
real-time motion estimation, high-frame-rate vision, gradient-based optical flow, accuracy
Computer vision,Computer graphics (images),Computer science,Optical flow estimation,Artificial intelligence
Journal
Volume
Issue
ISSN
24
4
0915-3942
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Lei Chen1177.06
Hua Yang2168.81
Takeshi Takaki322238.04
Idaku Ishii435564.37