Title
Identifying Surgical Instruments in Laparoscopy Using Deep Learning Instance Segmentation
Abstract
Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video recording is straightforward these days, automatic content indexing - the basis for content-based search in a medical video archive - is still a great challenge due to the very special video content. In this work, we investigate segmentation and recognition of surgical instruments in videos recorded from laparoscopic gynecology. More precisely, we evaluate the achievable performance of segmenting surgical instruments from their background by using a region-based fully convolutional network for instance-aware (1) instrument segmentation as well as (2) instrument recognition. While the first part addresses only binary segmentation of instances (i.e., distinguishing between instrument or background) we also investigate multi-class instrument recognition (i.e., identifying the type of instrument). Our evaluation results show that even with a moderately low number of training examples, we are able to localize and segment instrument regions with a pretty high accuracy. However, the results also reveal that determining the particular instrument is still very challenging, due to the inherently high similarity of surgical instruments.
Year
DOI
Venue
2019
10.1109/CBMI.2019.8877379
2019 International Conference on Content-Based Multimedia Indexing (CBMI)
Keywords
Field
DocType
surgical instruments,laparoscopic videos,instance segmentation,deep learning,data augmentation,region-based convolutional neural network
Laparoscopy,Computer vision,Market segmentation,Task analysis,Pattern recognition,Segmentation,Computer science,Search engine indexing,Image segmentation,Artificial intelligence,Deep learning,Robot
Conference
ISSN
ISBN
Citations 
1949-3983
978-1-7281-4674-4
0
PageRank 
References 
Authors
0.34
6
4
Name
Order
Citations
PageRank
Sabrina Kletz1217.71
Klaus Schoeffmann250963.01
Jenny Benois-Pineau343554.91
Heinrich Husslein431.44