Title
UnrealStereo: Controlling Hazardous Factors to Analyze Stereo Vision
Abstract
A reliable stereo algorithm is critical for many robotics applications. But textureless and specular regions can easily cause failure by making feature matching difficult. Understanding whether an algorithm is robust to these hazardous regions is important. Although many stereo benchmarks have been developed to evaluate performance, it is hard to quantify the effect of hazardous regions in real images because the location and severity of these regions are unknown. In this paper, we develop a synthetic image generation tool enabling to control hazardous factors, such as making objects more specular or transparent, to produce hazardous regions at different degrees. The densely controlled sampling strategy in virtual worlds enables to effectively stress test stereo algorithms by varying the types and degrees of the hazard. We generate a large synthetic image dataset with automatically computed hazardous regions and analyze algorithms on these regions. The observations from synthetic images are further validated by annotating hazardous regions in real-world datasets Middlebury and KITTI (which gives a sparse sampling of the hazards). Our synthetic image generation tool is based on a game engine Unreal Engine 4 and will be open-source along with the virtual scenes in our experiments. Many publicly available realistic game contents can be used by our tool to provide an enormous resource for development and evaluation of algorithms.
Year
DOI
Venue
2018
10.1109/3DV.2018.00035
2018 International Conference on 3D Vision (3DV)
Keywords
Field
DocType
stereo,dataset,robustness
Computer vision,Metaverse,Stereopsis,Computer science,Robustness (computer science),Solid modeling,Artificial intelligence,Sampling (statistics),Real image,Hazardous waste,Robotics
Conference
ISSN
ISBN
Citations 
2378-3826
978-1-5386-8426-9
6
PageRank 
References 
Authors
0.49
23
5
Name
Order
Citations
PageRank
Yi Zhang1475.12
Weichao Qiu2549.02
Qi Chen362.51
Xiaolin Hu464548.96
Alan L. Yuille5277.33