Title
Classifying and segmenting microscopy images with deep multiple instance learning.
Abstract
Motivation: High-content screening (HCS) technologies have enabled large scale imaging experiments for studying cell biology and for drug screening. These systems produce hundreds of thousands ofmicroscopy images per day and their utility depends on automated image analysis. Recently, deep learning approaches that learn feature representations directly from pixel intensity values have dominated object recognition challenges. These tasks typically have a single centered object per image and existing models are not directly applicable to microscopy datasets. Herewe develop an approach that combines deep convolutional neural networks (CNNs) with multiple instance learning (MIL) in order to classify and segment microscopy images using only whole image level annotations. Results: We introduce a new neural network architecture that uses MIL to simultaneously classify and segment microscopy images with populations of cells. We base our approach on the similarity between the aggregation function used in MIL and pooling layers used in CNNs. To facilitate aggregating across large numbers of instances in CNN feature maps we present the Noisy-AND pooling function, a new MIL operator that is robust to outliers. Combining CNNs with MIL enables training CNNs using whole microscopy images with image level labels. We show that training end-to-end MIL CNNs outperforms several previous methods on both mammalian and yeast datasets without requiring any segmentation steps.
Year
DOI
Venue
2016
10.1093/bioinformatics/btw252
BIOINFORMATICS
Field
DocType
Volume
Computer vision,Computer science,Convolutional neural network,Segmentation,Pooling,Outlier,Artificial intelligence,Pixel,Deep learning,Bioinformatics,Microscopy,Cognitive neuroscience of visual object recognition
Journal
32
Issue
ISSN
Citations 
12
1367-4803
20
PageRank 
References 
Authors
0.87
1
3
Name
Order
Citations
PageRank
Oren Z. Kraus1200.87
Lei Jimmy Ba28887296.55
Brendan J. Frey33637404.51