Paper Info
Title
Investigating the feasibility of finger identification on capacitive touchscreens using deep learning
Abstract
Touchscreens enable intuitive mobile interaction. However, touch input is limited to 2D touch locations which makes it challenging to provide shortcuts and secondary actions similar to hardware keyboards and mice. Previous work presented a wide range of approaches to provide secondary actions by identifying which finger touched the display. While these approaches are based on external sensors which are inconvenient, we use capacitive images from mobile touchscreens to investigate the feasibility of finger identification. We collected a dataset of low-resolution fingerprints and trained convolutional neural networks that classify touches from eight combinations of fingers. We focused on combinations that involve the thumb and index finger as these are mainly used for interaction. As a result, we achieved an accuracy of over 92% for a position-invariant differentiation between left and right thumbs. We evaluated the model and two use cases that users find useful and intuitive. We publicly share our data set (CapFingerld) comprising 455,709 capacitive images of touches from each finger on a representative mutual capacitive touchscreen and our models to enable future work using and improving them.
Year
DOI
Venue
2019
10.1145/3301275.3302295
Proceedings of the 24th International Conference on Intelligent User Interfaces
Keywords
Field
DocType
capacitive image, deep learning, finger identification, finger-aware interaction, smartphone, touchscreen
Index finger,Thumb,Use case,Convolutional neural network,Computer science,Touchscreen,Capacitive sensing,Human–computer interaction,Artificial intelligence,Deep learning,Mobile interaction
Conference
ISBN
Citations 
PageRank 
978-1-4503-6272-6
3
0.39
References 
Authors
49
3
Name
Order
Citations
PageRank
Huy Viet Le19513.02
Sven Mayer218827.30
Niels Henze31262108.47