Title
Joint 5D Pen Input for Light Field Displays
Abstract
Light field displays allow viewers to see view-dependent 3D content as if looking through a window; however, existing work on light field display interaction is limited. Yet, they have the potential to parallel 2D pen and touch screen systems, which present a joint input and display surface for natural interaction. We propose a 4D display and interaction space using a dual-purpose lenslet array, which combines light field display and light field pen sensing, and allows us to estimate the 3D position and 2D orientation of the pen. This method is simple, fast (150Hz), with position accuracy of 2-3mm and precision of 0.2-0.6mm from 0-350mm away from the lenslet array, and orientation accuracy of 2 degrees and precision of 0.2-0.3 degrees within a 45 degree field of view. Further, we 3D print the lenslet array with embedded baffles to reduce out-of-bounds cross-talk, and use an optical relay to allow interaction behind the focal plane. We demonstrate our joint display/sensing system with interactive light field painting.
Year
DOI
Venue
2015
10.1145/2807442.2807477
ACM Symposium on User Interface Software and Technology
Keywords
DocType
Citations 
Light Fields, Joint IO, Through-the-lens Sensing, Pen Input
Conference
5
PageRank 
References 
Authors
0.42
31
7
Name
Order
Citations
PageRank
James Tompkin133125.38
Samuel Muff2100.89
James McCann334523.78
Hanspeter Pfister45933340.59
Jan Kautz53615198.77
Marc Alexa668134.38
Wojciech Matusik74771254.42