Title
An adaptive solution for intra-operative gesture-based human-machine interaction
Abstract
Computerized medical systems play a vital role in the operating room, however, sterility requirements and interventional workflow often make interaction with these devices challenging for surgeons. Typical solutions, such as delegating physical control of keyboard and mouse to assistants, add an undesirable level of indirection. We present a touchless, gesture-based interaction framework for the operating room that lets surgeons define a personalized set of gestures for controlling arbitrary medical computerized systems. Instead of using cameras for capturing gestures, we rely on a few wireless inertial sensors, placed on the arms of the surgeon, eliminating the dependence on illumination and line-of-sight. A discriminative gesture recognition approach based on kernel regression allows us to simultaneously classify performed gestures and to track the relative spatial pose within each gesture, giving surgeons fine-grained control of continuous parameters. An extensible software architecture enables a dynamic association of learned gestures to arbitrary intraoperative computerized systems. Our experiments illustrate the performance of our approach and encourage its practical applicability.
Year
DOI
Venue
2012
10.1145/2166966.2166981
IUI
Keywords
Field
DocType
adaptive solution,dynamic association,arbitrary intraoperative computerized system,intra-operative gesture-based human-machine interaction,continuous parameter,arbitrary medical computerized system,physical control,discriminative gesture recognition approach,surgeons fine-grained control,gesture-based interaction framework,computerized medical system,operating room,gesture recognition,software architecture,kernel regression,sterilization,inertial sensors
Computer vision,Indirection,Wireless,Computer science,Gesture,Gesture recognition,Human–computer interaction,Inertial measurement unit,Artificial intelligence,Software architecture,Workflow,Discriminative model
Conference
Citations 
PageRank 
References 
19
1.03
14
Authors
3
Name
Order
Citations
PageRank
Ali Bigdelou1675.73
Loren Schwarz2553.51
Nassir Navab36594578.60