Title
AR-Weapon: Live Augmented Reality Based First-Person Shooting System
Abstract
This paper introduces a user-worn Augmented Reality (AR) based first-person weapon shooting system (AR-Weapon), suitable for both training and gaming. Different from existing AR-based first-person shooting systems, AR-Weapon does not use fiducial markers placed in the scene for tracking. Instead it uses natural scene features observed by the tracking camera from the live view of the world. The AR-Weapon system estimates 6-degrees of freedom orientation and location of the weapon and of the user operating it, thus allowing the weapon to fire simulated projectiles for both direct fire and non-line of sight during live runs. In addition, stereo cameras are used to compute depth and provide dynamic occlusion reasoning. Using the 6-DOF head and weapon tracking, dynamic occlusion reasoning and a terrain model of the environment, the fully virtual projectiles and synthetic avatars are displayed on the user's head mounted Optical-See-Through (OST) display overlaid over the live view of the real world. Since the projectiles, weapon characteristics and virtual enemy combatants are all simulated they can easily be changed to vary scenarios, new projectile types and future weapons. In this paper, we present the technical algorithms, system design and experiment results for a prototype AR-Weapon system.
Year
DOI
Venue
2015
10.1109/WACV.2015.88
WACV
Keywords
Field
DocType
ar-based first-person shooting systems,ost display,natural scene features,weapon characteristics,prototype ar-weapon system,terrain model,dynamic occlusion reasoning,projectiles,weapons,inference mechanisms,virtual projectiles,fire simulated projectiles,6-dof head tracking,user head mounted optical-see-through display,ar-weapon system,virtual enemy combatants,synthetic avatars,augmented reality,object tracking,cameras,user-worn augmented reality based first-person weapon shooting system,stereo cameras,natural scenes,tracking camera,stereo image processing,live augmented reality based first-person shooting system,visualization,navigation,head,databases
Computer vision,Stereo cameras,Fiducial marker,Computer graphics (images),Visualization,Computer science,Systems design,Augmented reality,Sight,Artificial intelligence,Raised-relief map,Projectile
Conference
ISSN
Citations 
PageRank 
2472-6737
0
0.34
References 
Authors
8
9
Name
Order
Citations
PageRank
Zhiwei Zhu169455.60
Vlad Branzoi240.87
Mikhail Sizintsev31498.87
Nicholas Vitovitch400.34
Taragay Oskiper5858.60
Ryan Villamil680.86
Ali Chaudhry700.68
Supun Samarasekera879285.72
Rakesh Kumar 00019162.52