Title
Evaluation and amelioration of computer-aided diagnosis with artificial neural networks utilizing small-sized sample sets.
Abstract
Concerns about the specificity and reliability of artificial neural networks (ANNs) impede further application of ANNs in medicine. This is particularly true when developing computer-aided diagnosis (CAD) tools using ANNs for orphan diseases and emerging research areas where only a small-sized sample set is available. It is unreasonable to claim one ANN's performance as better than another simply on the basis of a single output without considering possible output variability due to factors including data noise and ANN training protocols. In this paper, a bootstrap resampling method is proposed to quantitatively analyze ANN output reliability and changing performance as the sample data and training protocols are varied. The method is tested in the area of feature classification for analysis of masses detected on mammograms. Our experiments show that ANNs performance, measured in terms of the area under the receiver operating characteristic (ROC) curve, is not a fixed value, but follows a distribution function sensitive to many factors. We demonstrate that our approach to determining the bootstrap estimates of confidence intervals (CIs) and prediction intervals (PIs) can be used to assure optimal performance in terms of ANN model configuration. We also show that the unintentional inclusion of data noise, which biases ANN results in small task-specific databases, can be accurately detected via the bootstrap estimates. (c) 2012 Elsevier Ltd. All rights reserved.
Year
DOI
Venue
2013
10.1016/j.bspc.2012.11.001
Biomedical Signal Processing and Control
Keywords
Field
DocType
Bootstrap method,Artificial neural network (ANN) uncertainty,Computer-aided disease diagnosis,Small-sized sample set,Confidence interval (CI),Prediction interval (PI),Leave-one-out cross-validation
Data mining,Receiver operating characteristic,Pattern recognition,Computer-aided diagnosis,Bootstrapping (statistics),Prediction interval,Artificial intelligence,Artificial neural network,Confidence interval,Cross-validation,Bootstrapping (electronics),Mathematics
Journal
Volume
Issue
ISSN
8
3
1746-8094
Citations 
PageRank 
References 
1
0.38
21
Authors
4
Name
Order
Citations
PageRank
K. Y. Liu110.38
Michael R. Smith27911.34
Fear, E.C.39717.45
Rangaraj M. Rangayyan41316113.08