Title
A gesture control system for intuitive 3D interaction with virtual objects
Abstract
We present a system for interacting with 3D objects in a 3D virtual environment. Using the notion that a typical head-mounted display (HMD) does not cover the user's entire face, we use a fiducial marker placed on the HMD to locate the user's exposed facial skin. Using this information, a skin model is built and combined with the depth information obtained from a stereo camera. The information when used in tandem allows the position of the user's hands to be detected and tracked in real time. Once both hands are located, our system allows the user to manipulate the object with five degrees of freedom (translation in x-, y-, and z- axis with roll and yaw rotations) in virtual three-dimensional space using a series of intuitive hand gestures. Copyright © 2009 John Wiley & Sons, Ltd. Manipulating a 3D object in a Virtual 3D space. Left: the user manipulating the 3D object with an intuitive set of hand gestures. Right: the virtual 3D space ship displayed in the user's HMD being controlled in real time by the user.
Year
DOI
Venue
2010
10.1002/cav.v21:2
Journal of Visualization and Computer Animation
Keywords
Field
DocType
computer vision,augmented reality,virtual reality
Virtual reality,Virtual machine,Computer graphics (images),Computer science,Gesture,Gesture recognition,Augmented reality,3D interaction,Artificial intelligence,Computer vision,Stereo camera,Fiducial marker,Simulation
Journal
Volume
Issue
ISSN
21
2
1546-4261
Citations 
PageRank 
References 
1
0.35
10
Authors
5
Name
Order
Citations
PageRank
Corey Manders18913.16
Farzam Farbiz247552.46
Tang Ka Yin391.96
Miaolong Yuan4607.42
Gim Guan Chua5153.97