Title
Real-time image composition of bladder mosaics in fluorescence endoscopy
Abstract
Today, photodynamic diagnostics is commonly used in endoscopic intervention of the urinary bladder. Excited by a narrow band illumination, fluorescence markers enhance the visual contrast between benign and malignant tissue. Since in this modality the endoscope must be moved close to the bladder wall to provide sufficiently exposed images, the field of view (FOV) of the endoscope is very limited. This impedes the navigation and the re-identifying of multi-focal tumors for the physician. Thus, an image providing a larger FOV, composed from single images is highly desired during the intervention for surgery assistance. Since endoscopic mosaicking in real-time is still an open issue, we introduce a new feature-based image mosaicking algorithm for fluorescence endoscopy. Using a multi-threaded software design, the extraction of SURF features, the matching and the image stitching are separated in single processing threads. In an optimization step we discuss the trade-off between feature repeatability and processing time. After adjusting an optimal thread synchronization, the optimal workload of each thread results in a fast and real-time capable computation of image mosaics. On a standard hardware platform our algorithm performs within the RealTimeFrame framework with an update rate of 8.17 frames per second at full input image resolution (780脳576). Providing a fast growing image with an extended FOV during the intervention, the mosaic displayed on a second monitor promises high potential for surgery assistance.
Year
DOI
Venue
2011
10.1007/s00450-010-0135-z
Computer Science - R&D
Keywords
Field
DocType
image stitching,bladder wall,fluorescence endoscopy,new feature-based image,bladder mosaic,endoscopic intervention,larger fov,bladder cancer · fluorescence endoscopy · image mosaicking · panorama · image composition,surgery assistance,real-time image composition,image mosaic,extended fov,full input image resolution,single image,software design,real time,image resolution,frames per second,field of view
Field of view,Iterative reconstruction,Computer vision,Image stitching,Computer science,Image processing,Thread (computing),Feature extraction,Frame rate,Artificial intelligence,Image resolution
Journal
Volume
Issue
ISSN
26
1-2
1865-2042
Citations 
PageRank 
References 
11
0.73
21
Authors
6
Name
Order
Citations
PageRank
Alexander Behrens18011.81
Michael Bommes2202.04
Thomas Stehle38011.55
Sebastian Gross413114.59
Steffen Leonhardt531978.74
Til Aach6855117.45