Paper Info
Title
Enhancing A Laparoscopy Training System with Augmented Reality Visualization
Abstract
We report work in progress towards a system for laparoscopy training that is enhanced with an augmented reality display. The system can be used to perform peg-transfer training tasks using a Microsoft Hololens AR device, with full 6 degrees of freedom (DoF) shared presence with the pegboard workspace. This mode is in contrast to the conventional visualization, whose views are solely through a 2D or stereo laparoscope. In order to achieve this enhanced visualization, the system extracts the pose of the triangular prism being manipulated, and of the laparoscopic instruments with which the user manipulates the prism. These two objects are added to a CAD model of a (fixed) pegboard, and all the objects are visualized within the AR display. In the near future we expect to conduct user studies measuring accuracy and time-to-completion of this peg-transfer task using these new enhancements and compare it to conventional visualization techniques.
Year
DOI
Venue
2019
10.23919/SpringSim.2019.8732876
2019 Spring Simulation Conference (SpringSim)
Keywords
Field
DocType
Laparoscopes,Training,Visualization,Three-dimensional displays,Cameras,Minimally invasive surgery
CAD,Computer vision,Workspace,Work in process,Simulation,Training system,Computer science,Visualization,Degrees of freedom (mechanics),Augmented reality,Artificial intelligence,Creative visualization
Conference
ISBN
Citations 
PageRank 
978-1-5108-8388-8
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
hao jiang15917.96
Siqing Xu200.34
Andrei State3849139.88
Fan Feng400.68
Henry Fuchs541661248.53
Minsik Hong623.46
Jerzy W. Rozenblit726565.20