Title
An Indoor Scene Recognition-Based 3D Registration Mechanism for Real-Time AR-GIS Visualization in Mobile Applications.
Abstract
Mobile Augmented Reality (MAR) systems are becoming ideal platforms for visualization, permitting users to better comprehend and interact with spatial information. Subsequently, this technological development, in turn, has prompted efforts to enhance mechanisms for registering virtual objects in real world contexts. Most existing AR 3D Registration techniques lack the scene recognition capabilities needed to describe accurately the positioning of virtual objects in scenes representing reality. Moreover, the application of such registration methods in indoor AR-GIS systems is further impeded by the limited capacity of these systems to detect the geometry and semantic information in indoor environments. In this paper, we propose a novel method for fusing virtual objects and indoor scenes, based on indoor scene recognition technology. To accomplish scene fusion in AR-GIS, we first detect key points in reference images. Then, we perform interior layout extraction using a Fully Connected Networks (FCN) algorithm to acquire layout coordinate points for the tracking targets. We detect and recognize the target scene in a video frame image to track targets and estimate the camera pose. In this method, virtual 3D objects are fused precisely to a real scene, according to the camera pose and the previously extracted layout coordinate points. Our results demonstrate that this approach enables accurate fusion of virtual objects with representations of real world indoor environments. Based on this fusion technique, users can better grasp virtual three-dimensional representations on an AR-GIS platform.
Year
DOI
Venue
2018
10.3390/ijgi7030112
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION
Keywords
Field
DocType
AR-GIS,FCN,mobile phone,pose tracking,scene fusing
Spatial analysis,Computer vision,GRASP,Pose tracking,Visualization,Computer science,Semantic information,Augmented reality,Artificial intelligence,Mobile phone,Layout extraction
Journal
Volume
Issue
Citations 
7
3
1
PageRank 
References 
Authors
0.35
7
5
Name
Order
Citations
PageRank
Wei Ma11310.72
Hanjiang Xiong211.03
Xuefeng Dai3315.95
Xianwei Zheng4144.75
Yan Zhou511.37