Title
Dehazing cost volume for deep multi-view stereo in scattering media with airlight and scattering coefficient estimation
Abstract
We propose a learning-based multi-view stereo (MVS) method in scattering media, such as fog or smoke, with a novel cost volume, called the dehazing cost volume. Images captured in scattering media are degraded due to light scattering and attenuation caused by suspended particles. This degradation depends on scene depth; thus, it is difficult for traditional MVS methods to evaluate photometric consistency because the depth is unknown before three-dimensional (3D) reconstruction. The dehazing cost volume can solve this chicken-and-egg problem of depth estimation and image restoration by computing the scattering effect using swept planes in the cost volume. We also propose a method of estimating scattering parameters, such as airlight, and a scattering coefficient, which are required for our dehazing cost volume. The output depth of a network with our dehazing cost volume can be regarded as a function of these parameters; thus, they are geometrically optimized with a sparse 3D point cloud obtained at a structure-from-motion step. Experimental results on synthesized hazy images indicate the effectiveness of our dehazing cost volume against the ordinary cost volume regarding scattering media. We also demonstrated the applicability of our dehazing cost volume to real foggy scenes.
Year
DOI
Venue
2021
10.1016/j.cviu.2021.103253
Computer Vision and Image Understanding
Keywords
DocType
Volume
Multi-view stereo,Depth estimation,Scattering media,Airlight,Scattering coefficient
Journal
211
Issue
ISSN
Citations 
1
1077-3142
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Yuki Fujimura102.37
Motoharu Sonogashira201.01
Masaaki Iiyama31714.23