Title
A Shape Completion Component for Monocular Non-Rigid SLAM
Abstract
We propose a finite element method (FEM) based approach for surface stitching which can be integrated into existing SLAM and NRSfM pipelines for AR applications. Given individual reconstructions and camera poses at different time stamps, our stitching method incrementally completes the surface with a smooth transition between the hidden and the observed parts, so that all the observed parts can be stitched into a single surface. Thanks to the physical modelling, deformations from the observed parts are propagated to the hidden parts enabling an overall high-fidelity and realistic estimate. To keep the computational time in bounds, deformations near the observed parts are computed with FEM, and the remaining region is approximated by Laplacian deformation. We assume that no force is applied to the hidden parts. To evaluate the algorithm, we generate a synthetic dataset with ground truth. In our dataset, the camera observes only a part of the target surface in each frame and moves until the whole target surface is covered. The dataset which will be made publicly available includes the ground truth camera poses and geometries of the whole surface at each time frame. An experimental evaluation of the stitching method with accuracy metrics rounds out the draft.
Year
DOI
Venue
2019
10.1109/ISMAR-Adjunct.2019.00-18
2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Keywords
Field
DocType
non rigid SLAM,FEM,shape completion,monocular surface stitching
Computer vision,Image stitching,Pipeline transport,Computer science,Finite element method,Ground truth,Artificial intelligence,Deformation (mechanics),Monocular,Hull,Laplace operator
Conference
ISBN
Citations 
PageRank 
978-1-7281-4766-6
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Yongzhi Su121.41
Vladislav Golyanik200.34
Nareg Minaskan300.34
Sk Aziz Ali431.39
Didier Stricker51266138.03