Title
Real-time registration of video with ultrasound using stereo disparity
Abstract
Medical ultrasound typically deals with the interior of the patient, with the exterior left to the original medical imaging modality, direct human vision. For the human operator scanning the patient, the view of the external anatomy is essential for correctly locating the ultrasound probe on the body and making sense of the resulting ultrasound images in their proper anatomical context. The operator, after all, is not expected to perform the scan with his eyes shut. Over the past decade, our laboratory has developed a method of fusing these two information streams in the mind of the operator, the Sonic Flashlight, which uses a half silvered mirror and miniature display mounted on an ultrasound probe to produce a virtual image within the patient at its proper location. We are now interested in developing a similar data fusion approach within the ultrasound machine itself, by, in effect, giving vision to the transducer. Our embodiment of this concept consists of an ultrasound probe with two small video cameras mounted on it, with software capable of locating the surface of an ultrasound phantom using stereo disparity between the two video images. We report its first successful operation, demonstrating a 3D rendering of the phantom's surface with the ultrasound data superimposed at its correct relative location. Eventually, automated analysis of these registered data sets may permit the scanner and its associated computational apparatus to interpret the ultrasound data within its anatomical context, much as the human operator does today.
Year
DOI
Venue
2012
10.1117/12.911222
Proceedings of SPIE
Keywords
DocType
Volume
ultrasound,stereo matching,disparity,computer vision,Sonic Flashlight
Conference
8316
ISSN
Citations 
PageRank 
0277-786X
2
0.42
References 
Authors
16
5
Name
Order
Citations
PageRank
jihang wang120.42
samantha horvath232.05
George D. Stetten314622.70
Mel Siegel428280.67
J.M. Galeotti57513.90