Abstract | ||
---|---|---|
Computerized medical systems play a vital role in the operating room, however, sterility requirements and interventional workflow often make interaction with these devices challenging for surgeons. Typical solutions, such as delegating physical control of keyboard and mouse to assistants, add an undesirable level of indirection. We present a touchless, gesture-based interaction framework for the operating room that lets surgeons define a personalized set of gestures for controlling arbitrary medical computerized systems. Instead of using cameras for capturing gestures, we rely on a few wireless inertial sensors, placed on the arms of the surgeon, eliminating the dependence on illumination and line-of-sight. A discriminative gesture recognition approach based on kernel regression allows us to simultaneously classify performed gestures and to track the relative spatial pose within each gesture, giving surgeons fine-grained control of continuous parameters. An extensible software architecture enables a dynamic association of learned gestures to arbitrary intraoperative computerized systems. Our experiments illustrate the performance of our approach and encourage its practical applicability. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1145/2166966.2166981 | IUI |
Keywords | Field | DocType |
adaptive solution,dynamic association,arbitrary intraoperative computerized system,intra-operative gesture-based human-machine interaction,continuous parameter,arbitrary medical computerized system,physical control,discriminative gesture recognition approach,surgeons fine-grained control,gesture-based interaction framework,computerized medical system,operating room,gesture recognition,software architecture,kernel regression,sterilization,inertial sensors | Computer vision,Indirection,Wireless,Computer science,Gesture,Gesture recognition,Human–computer interaction,Inertial measurement unit,Artificial intelligence,Software architecture,Workflow,Discriminative model | Conference |
Citations | PageRank | References |
19 | 1.03 | 14 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ali Bigdelou | 1 | 67 | 5.73 |
Loren Schwarz | 2 | 55 | 3.51 |
Nassir Navab | 3 | 6594 | 578.60 |