Title
Ultrasound Tracking Using ProbeSight: Camera Pose Estimation Relative to External Anatomy by Inverse Rendering of a Prior High-Resolution 3D Surface Map
Abstract
This paper addresses the problem of freehand ultrasound probe tracking without requiring an external tracking device, by mounting a video camera on the probe to identify location relative to the patient's external anatomy. By pre-acquiring a high-resolution 3D surface map as an atlas of the anatomy, we eliminate the need for artificial skin markers. We use an OpenDR pipeline for inverse rendering and pose estimation via matching the real-time camera image with the 3D surface map. We have addressed the problem of distinguishing rotation from translation by including an inertial navigation system to accurately measure rotation. Experiments on both a phantom containing an image of human skin (palm) as well as actual human skin (fingers, palm, and wrist) validate the effectiveness of our approach. For ultrasound, this will permit the compilation of 3D ultrasound data as the probe is moved, as well as comparison of real-time ultrasound scans registered with previous scans from the same anatomical location. In a broader sense, tools that know where they are by looking at the patient's exterior could have broad beneficial impact on clinical medicine.
Year
DOI
Venue
2017
10.1109/WACV.2017.97
2017 IEEE Winter Conference on Applications of Computer Vision (WACV)
Keywords
Field
DocType
ProbeSight,camera pose estimation,external anatomy,inverse rendering,3D surface map,freehand ultrasound probe tracking,OpenDR pipeline,real-time camera image matching,inertial navigation system,clinical medicine
Inertial navigation system,Anatomical location,Anatomy,Computer science,Imaging phantom,Surface map,Pose,Artificial intelligence,Inverse rendering,Computer vision,Pattern recognition,Video camera,Ultrasound
Conference
ISSN
ISBN
Citations 
2472-6737
978-1-5090-4823-6
0
PageRank 
References 
Authors
0.34
9
6
Name
Order
Citations
PageRank
Jihang Wang100.34
Chengqian Che200.68
J.M. Galeotti37513.90
samantha horvath432.05
Vijay Gorantla511.05
George D. Stetten614622.70