Title
Augmented reality image guidance for minimally invasive coronary artery bypass
Abstract
We propose a novel system for image guidance in totally endoscopic coronary artery bypass (TECAB). A key requirement is the availability of 2D-3D registration techniques that can deal with non-rigid motion and deformation. Image guidance for TECAB is mainly required before the mechanical stabilization of the heart, thus the most dominant source of non-rigid deformation is the motion of the beating heart. To augment the images in the endoscope of the da Vinci robot, we have to find the transformation from the coordinate system of the preoperative imaging modality to the system of the endoscopic cameras. In a first step we build a 4D motion model of the beating heart. Intraoperatively we can use the ECG or video processing to determine the phase of the cardiac cycle. We can then take the heart surface from the motion model and register it to the stereo-endoscopic images of the da Vinci robot using 2D-3D registration methods. We are investigating robust feature tracking and intensity-based methods for this purpose. Images of the vessels available in the preoperative coordinate system can then be transformed to the camera system and projected into the calibrated endoscope view using two video mixers with chroma keying. It is hoped that the augmented view can improve the efficiency of TECAB surgery and reduce the conversion rate to more conventional procedures.
Year
DOI
Venue
2008
10.1117/12.774788
PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS (SPIE)
Keywords
Field
DocType
image-guided therapy,registration,medical robotics,localization & tracking technologies,endoscopic procedures
Coordinate system,Endoscope,Computer vision,Video processing,Keying,Augmented reality,Artificial intelligence,Cardiac cycle,Image-Guided Therapy,Engineering,Robot
Conference
Volume
ISSN
Citations 
6918
0277-786X
4
PageRank 
References 
Authors
0.44
12
10
Name
Order
Citations
PageRank
Michael Figl1657.33
Daniel Rueckert29338637.58
David J. Hawkes34262470.26
Roberto Casula4453.61
Mingxing Hu537731.19
Ose Pedro6111.39
Dong Ping Zhang71537.55
Graeme P. Penney898790.21
Fernando Bello926142.21
p j edwards10131.11