Generating ROC curves for artificial neural networks

Receiver operating characteristic (ROC) analysis is an established method of measuring diagnostic performance in medical imaging studies. Traditionally, artificial neural networks (ANN's) have been applied as a classifier to find one "best" detection rate. Recently researchers have begun to report ROC curve results for ANN classifiers. The current standard method of generating ROC curves for an ANN is to vary the output node threshold for classification. Here, the authors propose a different technique for generating ROC curves for a two class ANN classifier. They show that this new technique generates better ROC curves in the sense of having greater area under the ROC curve (AUC), and in the sense of being composed of a better distribution of operating points.

[1]  Kunio Doi,et al.  Neural network approach for differential diagnosis of interstitial lung diseases , 1990, Medical Imaging: Image Processing.

[2]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  Carey E. Priebe,et al.  Comparative evaluation of pattern recognition techniques for detection of microcalcifications , 1993, Electronic Imaging.

[4]  C. Metz.  ROC Methodology in Radiologic Imaging , 1986, Investigative radiology.

[5]  Maryellen L. Giger,et al.  A NEURAL NETWORK APPROACH FOR DIFFERENTIAL DIAGNOSIS OF INTERSTITIAL LUNG DISEASES , 1990 .

[6]  J M Boone,et al.  Neural networks in radiology: an introduction and evaluation in a signal detection task. , 1990, Medical physics.

[7]  W. Kegelmeyer,et al.  Dense feature maps for detection of calcifications , 1994 .

[8]  K Doi,et al.  Computerized detection of clustered microcalcifications in digital mammograms: applications of artificial neural networks. , 1992, Medical physics.

[9]  I. Bankman,et al.  Feature-based detection of the K-complex wave in the human electroencephalogram using neural networks , 1992, IEEE Transactions on Biomedical Engineering.

[10]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[11]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[12]  G. W. Gross,et al.  Neural networks in radiologic diagnosis. II. Interpretation of neonatal chest radiographs. , 1990, Investigative radiology.

[13]  Kevin Knight,et al.  Connectionist ideas and algorithms , 1990, CACM.

[14]  J. Swets.  ROC analysis applied to the evaluation of medical imaging techniques. , 1979, Investigative radiology.