Title
Cross-Scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images.
Abstract
Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image driven" MIL algorithms which overlook the multi-scale (i.e. pyramidal) nature of WSIs. Off-the-shelf MIL algorithms are typically deployed on a single-scale of WSIs (e.g., 20× magnification), while human pathologists usually aggregate the global and local patterns in a multi-scale manner (e.g., by zooming in and out between different magnifications). In this study, we propose a novel cross-scale attention mechanism to explicitly aggregate inter-scale interactions into a single MIL network for Crohn's Disease (CD), which is a form of inflammatory bowel disease. The contribution of this paper is two-fold: (1) a cross-scale attention mechanism is proposed to aggregate features from different resolutions with multi-scale interaction; and (2) differential multi-scale attention visualizations are generated to localize explainable lesion patterns. By training ~250,000 H&E-stained Ascending Colon (AC) patches from 20 CD patient and 30 healthy control samples at different scales, our approach achieved a superior Area under the Curve (AUC) score of 0.8924 compared with baseline models. The official implementation is publicly available at https://github.com/hrlblab/CS-MIL.
Year
DOI
Venue
2022
10.1007/978-3-031-18814-5_3
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)
Keywords
DocType
Volume
Attention Mechanism,Multi-instance Learning,Multi-scale,Pathology
Conference
13594
Citations 
PageRank 
References 
0
0.34
0
Authors
15
Name
Order
Citations
PageRank
Ruining Deng153.23
Can Cui200.34
Lucas W Remedios300.34
Shunxing Bao4123.38
R Michael Womick500.34
Sophie Chiron600.34
Jia Li700.34
Joseph T. Roland821.13
Ken S Lau901.01
Qi Liu1056849.57
Keith T Wilson1100.34
Yaohong Wang1200.34
Lori A Coburn1300.34
Bennett A Landman1400.34
Yuankai Huo1500.34