Title
Human-assisted motion annotation
Abstract
Obtaining ground-truth motion for arbitrary, real-world video sequences is a challenging but important task for both algorithm evaluation and model design. Existing ground-truth databases are either synthetic, such as the Yosemite sequence, or limited to indoor, experimental setups, such as the database developed by Baker et al (2007). We propose a human-in-loop methodology to create a ground-truth motion database for the videos taken with ordinary cameras in both indoor and outdoor scenes, using the fact that human beings are experts at segmenting objects and inspecting the match between two frames. We designed an interactive computer vision system to allow a user to efficiently annotate motion. Our methodology is cross-validated by showing that human annotated motion is repeatable, consistent across annotators, and close to the ground truth obtained by Baker et al (2007). Using our system, we collected and annotated 10 indoor and outdoor real-world videos to form a ground-truth motion database. The source code, annotation tool and database is online for public evaluation and benchmarking.
Year
DOI
Venue
2008
10.1109/CVPR.2008.4587845
CVPR
Keywords
Field
DocType
interactive computer vision system,video signal processing,human-in-loop methodology,image matching,ground-truth databases,ground-truth motion database,visual databases,image segmentation,annotation tool,ground-truth motion,image sensors,image sequences,indoor-outdoor scenes,real-world video sequences,human-assisted motion annotation,yosemite sequence,public evaluation,image motion analysis,computer vision,motion estimation,source code,databases,labeling,adaptive optics,ground truth,cross validation,algorithm design and analysis,optical imaging,estimation
Computer vision,Annotation,Algorithm design,Image sensor,Source code,Computer science,Image segmentation,Ground truth,Artificial intelligence,Optical imaging,Benchmarking
Conference
Volume
Issue
ISSN
2008
1
1063-6919 E-ISBN : 978-1-4244-2243-2
ISBN
Citations 
PageRank 
978-1-4244-2243-2
94
5.23
References 
Authors
22
4
Name
Order
Citations
PageRank
Ce Liu13347188.04
William T. Freeman2173821968.76
Edward H. Adelson31768320.52
Yair Weiss410240834.60