Title
Flexpad: highly flexible bending interactions for projected handheld displays
Abstract
Flexpad is an interactive system that combines a depth camera and a projector to transform sheets of plain paper or foam into flexible, highly deformable, and spatially aware handheld displays. We present a novel approach for tracking deformed surfaces from depth images in real time. It captures deformations in high detail, is very robust to occlusions created by the user's hands and fingers, and does not require any kind of markers or visible texture. As a result, the display is considerably more deformable than in previous work on flexible handheld displays, enabling novel applications that leverage the high expressiveness of detailed deformation. We illustrate these unique capabilities through three application examples: curved cross-cuts in volumetric images, deforming virtual paper characters, and slicing through time in videos. Results from two user studies show that our system is capable of detecting complex deformations and that users are able to perform them quickly and precisely.
Year
DOI
Venue
2013
10.1145/2470654.2470688
CHI
Keywords
Field
DocType
plain paper,high expressiveness,depth camera,enabling novel application,high detail,flexible handheld display,interactive system,real time,depth image,novel approach,deformation,tracking,flexible display,bending,projection
Computer vision,Computer graphics (images),Computer science,Slicing,Projector,Bending,Mobile device,Artificial intelligence,Volumetric data,User studies,Expressivity,Flexible display
Conference
Citations 
PageRank 
References 
42
1.52
34
Authors
3
Name
Order
Citations
PageRank
Jürgen Steimle129421.38
Andreas Jordt2796.02
Patricia Maes379411719.73