Title
Surgical Instrument Segmentation for Endoscopic Vision with Data Fusion of rediction and Kinematic Pose.
Abstract
The real-time and robust surgical instrument segmentation is an important issue for endoscopic vision. We propose an instrument segmentation method fusing the convolutional neural networks (CNN) prediction and the kinematic pose information. First, the CNN model ToolNet-C is designed, which cascades a convolutional feature extractor trained over numerous unlabeled images and a pixel-wise segmentor trained on few labeled images. Second, the silhouette projection of the instrument body onto the endoscopic image is implemented based on the measured kinematic pose. Third, the particle filter with the shape matching likelihood and the weight suppression is proposed for data fusion, whose estimate refines the kinematic pose. The refined pose determines an accurate silhouette mask, which is the final segmentation output. The experiments are conducted with a surgical navigation system, several animal-tissue backgrounds, and a debrider instrument.
Year
DOI
Venue
2019
10.1109/ICRA.2019.8794122
ICRA
Field
DocType
Volume
Computer vision,Kinematics,Segmentation,Convolutional neural network,Silhouette,Surgical instrument,Control engineering,Feature extraction,Image segmentation,Sensor fusion,Artificial intelligence,Engineering
Conference
2019
Issue
Citations 
PageRank 
1
1
0.35
References 
Authors
6
5
Name
Order
Citations
PageRank
Fangbo Qin1114.78
Yangming Li238020.91
Yun-Hsuan Su3125.27
De Xu46210.73
Blake Hannaford52527516.26