Title
Specam: Sensing Surface Color And Material With The Front-Facing Camera Of A Mobile Device
Abstract
SpeCam is a lightweight surface color and material sensing approach for mobile devices which only uses the front-facing camera and the display as a multi-spectral light source. We leverage the natural use of mobile devices (placing it face-down) to detect the material underneath and therefore infer the location or placement of the device. SpeCam can then be used to support discreet micro-interactions to avoid the numerous distractions that users daily face with today's mobile devices. Our two-parts study shows that SpeCam can i) recognize colors in the HSB space with 10 degrees apart near the 3 dominant colors and 4 degrees otherwise and ii) 30 types of surface materials with 99% accuracy. These findings are further supported by a spectroscopy study. Finally, we suggest a series of applications based on simple mobile micro-interactions suitable for using the phone when placed face-down.
Year
DOI
Venue
2017
10.1145/3098279.3098541
PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI '17)
Keywords
Field
DocType
Surface detection, material detection, discreet interaction
Color detection,Computer graphics (images),Computer science,Phone,Mobile device,Light source
Conference
Citations 
PageRank 
References 
5
0.56
18
Authors
5
Name
Order
Citations
PageRank
Hui-Shyong Yeo113214.53
Ju-young Lee28814.60
Andrea Bianchi329026.29
David Harris-Birtill4283.30
A. Quigley584684.08