Paper Info
Title
When camera meets accelerometer: a novel way for 3d interaction of mobile phone
Abstract
Performing real-time 3D motion interaction with a mobile phone is useful for extending interaction out of a limited screen. However, current phone motion detection approaches, which use only camera or accelerometer, have limitations in recognizing versatile 3D motions simultaneously. In this paper we present a real-time approach designed for 3D tasks by holding and moving a phone equipped with both a camera and an accelerometer. By analyzing both motion features from image frames and changes of accelerometer data simultaneously, our approach can naturally distinguish translation and rotation of a mobile phone. In a pilot user study, we demonstrated our design requires low learning effort and has high accuracy. Since it does not require any outside infrastructure, our approach can be applied to any phone with a camera and an accelerometer. Our main contribution is giving mobile phone users 3D interaction ability by exploiting hand translation and rotation.
Year
DOI
Venue
2012
10.1145/2371664.2371689
Mobile HCI (Companion)
Keywords
Field
DocType
real-time approach,motion interaction,interaction ability,hand translation,motion feature,mobile phone,current phone motion detection,mobile phone user,high accuracy,accelerometer data,accelerometer,fusion
Computer vision,Motion detection,Computer science,Accelerometer,Phone,Artificial intelligence,3D interaction,Mobile phone
Conference
Citations 
PageRank 
References 
2
0.37
7
Authors
3
Name
Order
Citations
PageRank
Mingming Fan14810.29
Donald J. Patterson21765219.99
Yuanchun Shi31005135.34