Title
Issues in Assessing Multi-Institutional Performance of BI-RADS-based CAD Systems
Abstract
The purpose of this study was to investigate factors that impact the generalization of breast cancer computer-aided diagnosis (CAD) systems that utilize the Breast Imaging Reporting and Data System (BI-RADS (TM)). Data sets from four institutions were analyzed: Duke University Medical Center, University of Pennsylvania Medical Center, Massachusetts General Hospital, and Wake Forest University. The latter two data sets are subsets of the Digital Database for Screening Mammography. Each data set consisted of descriptions of mammographic lesions according to the BI-RADS lexicon, patient age, and pathology status (benign/malignant). Models were developed to predict pathology status from the BI-RADS descriptors and the patient age. Comparisons between the models built on data from the different institutions were made in terms of empirical (non-para metric) receiver operating characteristic (ROC) curves. Results suggest that BI-RADS-based CAD systems focused on specific classes of lesions may be more generally applicable than models that cover several lesion types. However, better generalization was seen in terms of the area under the ROC curve than in the partial area index (> 90% sensitivity). Previous studies have illustrated the challenges in translating a BI-RADS-based CAD system from one institution to another. This study provides new insights into possible approaches to improve the c Generalization of BI-RADS-based CAD systems.
Year
DOI
Venue
2005
10.1117/12.594706
PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS (SPIE)
Keywords
DocType
Volume
diagnosis,computer-assisted,mammography,breast neoplasms,ROC curve,sensitivity and specificity,medical informatics,pattern recognition,calibration
Conference
5747
ISSN
Citations 
PageRank 
0277-786X
0
0.34
References 
Authors
4
2
Name
Order
Citations
PageRank
Mia K. Markey135333.66
Y. Lob200.34