Title
Fast and robust optical flow for time-lapse microscopy using super-voxels.
Abstract
Optical flow is a key method used for quantitative motion estimation of biological structures in light microscopy. It has also been used as a key module in segmentation and tracking systems and is considered a mature technology in the field of computer vision. However, most of the research focused on 2D natural images, which are small in size and rich in edges and texture information. In contrast, 3D time-lapse recordings of biological specimens comprise up to several terabytes of image data and often exhibit complex object dynamics as well as blurring due to the point-spread-function of the microscope. Thus, new approaches to optical flow are required to improve performance for such data.We solve optical flow in large 3D time-lapse microscopy datasets by defining a Markov random field (MRF) over super-voxels in the foreground and applying motion smoothness constraints between super-voxels instead of voxel-wise. This model is tailored to the specific characteristics of light microscopy datasets: super-voxels help registration in textureless areas, the MRF over super-voxels efficiently propagates motion information between neighboring cells and the background subtraction and super-voxels reduce the dimensionality of the problem by an order of magnitude. We validate our approach on large 3D time-lapse datasets of Drosophila and zebrafish development by analyzing cell motion patterns. We show that our approach is, on average, 10 × faster than commonly used optical flow implementations in the Insight Tool-Kit (ITK) and reduces the average flow end point error by 50% in regions with complex dynamic processes, such as cell divisions.Source code freely available in the Software section at http://janelia.org/lab/keller-lab.
Year
DOI
Venue
2013
10.1093/bioinformatics/bts706
Bioinformatics
Keywords
Field
DocType
optical flow implementation,motion smoothness constraint,super-voxels help registration,propagates motion information,cell motion pattern,quantitative motion estimation,time-lapse microscopy,average flow end point,image data,optical flow,robust optical flow,supplementary information,microscopy,zebrafish
Background subtraction,Computer vision,Markov random field,Computer science,Segmentation,Source code,Tracking system,Software,Artificial intelligence,Bioinformatics,Motion estimation,Optical flow
Journal
Volume
Issue
ISSN
29
3
1367-4811
Citations 
PageRank 
References 
15
0.77
27
Authors
3
Name
Order
Citations
PageRank
Fernando Amat1643.27
Eugene Myers23164496.92
Philipp J. Keller3181.92