Paper Info
Title
PointPose: finger pose estimation for touch input on mobile devices using a depth sensor
Abstract
The expressiveness of touch input can be increased by detecting additional finger pose information at the point of touch such as finger rotation and tilt. PointPose is a prototype that performs finger pose estimation at the location of touch using a short-range depth sensor viewing the touch screen of a mobile device. We present an algorithm that extracts finger rotation and tilt from a point cloud generated by a depth sensor oriented towards the device's touchscreen. The results of two user studies we conducted show that finger pose information can be extracted reliably using our proposed method. We show this for controlling rotation and tilt axes separately and also for combined input tasks using both axes. With the exception of the depth sensor, which is mounted directly on the mobile device, our approach does not require complex external tracking hardware, and, furthermore, external computation is unnecessary as the finger pose extraction algorithm can run directly on the mobile device. This makes PointPose ideal for prototyping and developing novel mobile user interfaces that use finger pose estimation.
Year
DOI
Venue
2013
10.1145/2512349.2512824
ITS
Keywords
Field
DocType
touch screen,short-range depth sensor,mobile device,use finger,finger rotation,touch input,novel mobile user interface,extracts finger rotation,depth sensor,additional finger,point cloud,mobile interaction
Computer vision,Computer science,Finger tracking,Touchscreen,Pose,Mobile device,Artificial intelligence,Mobile interaction,User interface,Point cloud,Computation
Conference
Citations 
PageRank 
References 
12
0.65
19
Authors
3
Name
Order
Citations
PageRank
Sven Kratz156728.08
Patrick Chiu219920.38
Maribeth Back363695.26