Title
Vision-based markerless registration using stereo vision and an augmented reality surgical navigation system: a pilot study.
Abstract
This study evaluated the use of an augmented reality navigation system that provides a markerless registration system using stereo vision in oral and maxillofacial surgery.A feasibility study was performed on a subject, wherein a stereo camera was used for tracking and markerless registration. The computed tomography data obtained from the volunteer was used to create an integral videography image and a 3-dimensional rapid prototype model of the jaw. The overlay of the subject's anatomic site and its 3D-IV image were displayed in real space using a 3D-AR display. Extraction of characteristic points and teeth matching were done using parallax images from two stereo cameras for patient-image registration.Accurate registration of the volunteer's anatomy with IV stereoscopic images via image matching was done using the fully automated markerless system, which recognized the incisal edges of the teeth and captured information pertaining to their position with an average target registration error of < 1 mm. These 3D-CT images were then displayed in real space with high accuracy using AR. Even when the viewing position was changed, the 3D images could be observed as if they were floating in real space without using special glasses.Teeth were successfully used for registration via 3D image (contour) matching. This system, without using references or fiducial markers, displayed 3D-CT images in real space with high accuracy. The system provided real-time markerless registration and 3D image matching via stereo vision, which, combined with AR, could have significant clinical applications.
Year
DOI
Venue
2015
10.1186/s12880-015-0089-5
BMC Medical Imaging
Keywords
Field
DocType
Augmented reality, Integral videography, Markerless registration, Stereo vision, Three-dimensional image
Video recording,Computer vision,Computer graphics (images),Stereopsis,Navigation system,Vision based,Augmented reality,Oral and maxillofacial surgery,Artificial intelligence,Medicine,Oral Surgical Procedures
Journal
Volume
Issue
ISSN
15
1
1471-2342
Citations 
PageRank 
References 
4
0.47
12
Authors
7
Name
Order
Citations
PageRank
Hideyuki Suenaga1463.15
Huy Hoang Tran2263.15
Hongen Liao339070.91
Ken Masamune425348.57
Takeyoshi Dohi549697.71
Kazuto Hoshi6352.47
Tsuyoshi Takato780.93