Title
Free-form object reconstruction from silhouettes, occluding edges and texture edges: a unified and robust operator based on duality.
Abstract
In this paper, the duality in differential form is developed between a 3D primal surface and its dual manifold formed by the surface's tangent planes, i.e., each tangent plane of the primal surface is represented as a four-dimensional vector which constitutes a point on the dual manifold. The iterated dual theorem shows that each tangent plane of the dual manifold corresponds to a point on the original 3D surface, i.e., the dual of the dual goes back to the primal. This theorem can be directly used to reconstruct 3D surface from image edges by estimating the dual manifold from these edges. In this paper we further develop the work in our original conference papers resulting in the robust differential dual operator. We argue that the operator makes good use of the information available in the image data, by using both points of intensity discontinuity and their edge directions; we provide a simple physical interpretation of what the abstract algorithm is actually estimating and why it makes sense in terms of estimation accuracy; our algorithm operates on all edges in the images, including silhouette edges, self occlusion edges, and texture edges, without distinguishing their types (thus resulting in improved accuracy and handling locally concave surface estimation if texture edges are present); the algorithm automatically handles various degeneracies; and the algorithm incorporates new methodologies for implementing the required operations such as appropriately relating edges in pairs of images, evaluating and using the algorithm's sensitivity to noise to determine the accuracy of an estimated 3D point. Experiments with both synthetic and real images demonstrate that the operator is accurate, robust to degeneracies and noise, and general for reconstructing free-form objects from occluding edges and texture edges detected in calibrated images or video sequences.
Year
DOI
Venue
2008
10.1109/TPAMI.2007.1143
IEEE Trans. Pattern Anal. Mach. Intell.
Keywords
Field
DocType
texture edges,dual manifold corresponds,iterated dual theorem,abstract algorithm,texture edge,free-form object reconstruction,robust differential dual operator,primal surface,estimation accuracy,dual manifold,concave surface estimation,occluding edges,tangent plane,robust operator,dynamic programming,interpolation,image texture,differential forms,iterative methods,surface reconstruction,3d reconstruction,surface texture,shape,duality mathematics,noise shaping,image reconstruction
Computer vision,Image texture,Computer science,Duality (mathematics),Image processing,Tangent,Duality (optimization),Artificial intelligence,Real image,Multiple edges,Tangent space
Journal
Volume
Issue
ISSN
30
1
0162-8828
Citations 
PageRank 
References 
11
0.67
27
Authors
4
Name
Order
Citations
PageRank
Shubao Liu115610.25
Kongbin Kang2835.38
Jean-Philippe Tarel380556.63
David B. Cooper4786388.68