Name
Title | ||
|---|---|---|
SWAG Demo: Smart Watch Assisted Gesture Interaction for Mixed Reality Head-Mounted Displays |
Abstract | ||
|---|---|---|
In this demonstration, we will show a prototype system with sensor fusion approach to robustly track 6 degrees of freedom of hand movement and support intuitive hand gesture interaction and 3D object manipulation for Mixed Reality head-mounted displays. Robust tracking of hand and finger with egocentric camera remains a challenging problem, especially with self-occlusion – for example, when user tries to grab a virtual object in midair by closing the palm. Our approach leverages the use of a common smart watch worn on the wrist to provide a more reliable palm and wrist orientation data, while fusing the data with camera to achieve robust hand motion and orientation for interaction. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/ISMAR-Adjunct.2018.00130 | 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) |
Keywords | Field | DocType |
Augmented reality | Virtual image,Computer vision,Wearable computer,Computer science,Gesture,Degrees of freedom (mechanics),Sensor fusion,Augmented reality,Artificial intelligence,Mixed reality,Smartwatch | Conference |
ISBN | Citations | PageRank |
978-1-5386-7592-2 | 0 | 0.34 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Hyungil Kim | 1 | 265 | 40.70 |
| Ju-young Lee | 2 | 88 | 14.60 |
| Hui-Shyong Yeo | 3 | 132 | 14.53 |
| A. Quigley | 4 | 846 | 84.08 |
| Woontack Woo | 5 | 1284 | 143.58 |