Evaluation of the logarithmic-sensitivity index as a neural network stopping criterion for rare outcomes

Rare outcomes are often difficult to classify using an automated neural network. The logarithmic-sensitivity index was introduced to optimize both sensitivity and specificity at the same time while slightly favouring sensitivity. This index succeeded in identifying the optimal stopping point when training an automated network to classify rare outcomes. The automated networks achieved equal or better classification performance than the manually-optimized networks. When the classification performance of the maximum log-sensitivity index is compared with networks whose stopping criteria are based on the highest correct classification rate or the lowest mean squared error, the log-sensitivity networks better classified the rare outcomes (higher sensitivity) while maintaining a sufficiently high specificity rate. This means that the log-sensitivity index is a valuable time-saving tool, because the networks can be run automatically without user supervision and classification performance is not compromised.

[1]  Monique Frize,et al.  Logarithmic-sensitivity index as a stopping criterion for automated neural networks , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[2]  R. Lippmann,et al.  Coronary artery bypass risk prediction using neural networks. , 1997, Annals of Thoracic Surgery.

[3]  Monique Frize,et al.  Automated optimization of neural networks in estimating medical outcomes , 2000, Proceedings 2000 IEEE EMBS International Conference on Information Technology Applications in Biomedicine. ITAB-ITIS 2000. Joint Meeting Third IEEE EMBS International Conference on Information Technol.

[4]  Monique Frize,et al.  Influence of Missing Values on Artificial Neural Network Performance , 2001, MedInfo.

[5]  Colleen M. Ennett Coronary surgery mortality prediction using artificial neural networks. , 1999 .

[6]  M. Frize,et al.  Methodologies for predicting coronary surgery outcomes , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[7]  Monique Frize,et al.  Investigation into the Strengths and Limitations of Artificial Neural Networks: An Application to an Adult ICU Patient Database , 1998, AMIA.

[8]  D. Richardson,et al.  Score for Neonatal Acute Physiology: a physiologic severity index for neonatal intensive care. , 1993, Pediatrics.

[9]  G. Escobar,et al.  SNAP-II and SNAPPE-II: Simplified newborn illness severity and mortality risk scores. , 2001, The Journal of pediatrics.

[10]  R. E. Clark,et al.  Calculating risk and outcome: The Society of Thoracic Surgeons database. , 1996, The Annals of thoracic surgery.