Title
HeatWave: thermal imaging for surface user interaction
Abstract
We present HeatWave, a system that uses digital thermal imaging cameras to detect, track, and support user interaction on arbitrary surfaces. Thermal sensing has had limited examination in the HCI research community and is generally under-explored outside of law enforcement and energy auditing applications. We examine the role of thermal imaging as a new sensing solution for enhancing user surface interaction. In particular, we demonstrate how thermal imaging in combination with existing computer vision techniques can make segmentation and detection of routine interaction techniques possible in real-time, and can be used to complement or simplify algorithms for traditional RGB and depth cameras. Example interactions include (1) distinguishing hovering above a surface from touch events, (2) shape-based gestures similar to ink strokes, (3) pressure based gestures, and (4) multi-finger gestures. We close by discussing the practicality of thermal sensing for naturalistic user interaction and opportunities for future work.
Year
DOI
Venue
2011
10.1145/1978942.1979317
CHI
Keywords
Field
DocType
hci research community,arbitrary surface,support user interaction,thermal imaging,routine interaction technique,example interaction,surface user interaction,computer vision technique,user surface interaction,digital thermal imaging camera,naturalistic user interaction,user interfaces,interaction technique,user interface,gestures,computer vision
Computer vision,Thermal,Computer science,Segmentation,Gesture,Thermal sensing,Human–computer interaction,Artificial intelligence,RGB color model,User interface
Conference
Citations 
PageRank 
References 
25
1.40
26
Authors
7
Name
Order
Citations
PageRank
Eric Larson1123077.28
Gabe Cohn227917.41
Sidhant Gupta397252.23
Xiaofeng Ren44271209.11
Beverly Harrison52187305.77
Dieter Fox6123061289.74
Shwetak N. Patel72967211.74