Prediction of Community-Acquired Pneumonia Using Artificial Neural Networks

Background. Artificial neural networks (ANN) have been used in the prediction of several medical conditions but have not been previously used to predict pneumonia. The authors used ANN to predict the presence or absence of pneumonia among patients presenting to the emergency department with acute respiratory complaints and compared the results with those obtained using logistic regression modeling. Methods. Feed-forward back-propagation ANN were trained on sociodemographic, symptom, sign, comorbidity, and radiographic outcome data among 1044 patients from the University of Illinois (the training cohort) and were applied to 116 patients from the University of Nebraska (the testing cohort). ANN trained using different strategies were compared to each other and to main-effects logistic regression. Calibration accuracy was measured as mean square error and discrimination accuracy as the area under a receiver operating characteristic (ROC) curve. Results. A 1 hidden-layer ANN trained using oversampling of pneumonia cases had an ROC area in the training cohort of 0.895, which was greater than the area of 0.840 for logistic regression (P = 0.026). This ANN had an ROC area in the testing cohort of 0.872, not significantly different from its area in the training cohort (P = 0.597). Operating at a threshold of 0.25, the ANN would have detected 94% to 95% of patients with pneumonia in the 2 cohorts while correctly excluding 39% to 50% of patients with other conditions. ANN trained using other strategies discriminated equally in the 2 cohorts but no better than did logistic regression. Conclusions. Among adults presenting with acute respiratory illness, ANN accurately discriminated patients with and without pneumonia and, under some circumstances, improved on the accuracy of logistic regression.

[1]  A. El‐Solh,et al.  Predicting active pulmonary tuberculosis using an artificial neural network. , 1999, Chest.

[2]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[3]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[4]  M. Fine,et al.  Does this patient have community-acquired pneumonia? Diagnosing pneumonia by history and physical examination. , 1997, JAMA.

[5]  E. Ibrahim,et al.  Clinical prediction rule for pulmonary infiltrates. , 1998, Saudi medical journal.

[6]  P. Diehr,et al.  Prediction of pneumonia in outpatients with acute cough--a statistical approach. , 1984, Journal of chronic diseases.

[7]  Sungzoon Cho,et al.  Multiple disorder diagnosis with adaptive competitive neural networks , 1993, Artif. Intell. Medicine.

[8]  C. Floyd,et al.  Acute pulmonary embolism: artificial neural network approach for diagnosis. , 1993, Radiology.

[9]  M. Rubenfire,et al.  Neural network in the clinical diagnosis of acute pulmonary embolism. , 1993, Chest.

[10]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[11]  Paul S. Heckerling,et al.  Parametric receiver operating characteristic curve analysis using mathematica , 2002, Comput. Methods Programs Biomed..

[12]  W. Baxt Analysis of the clinical variables driving decision in an artificial neural network trained to identify the presence of myocardial infarction. , 1992, Annals of emergency medicine.

[13]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[14]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[15]  M L Astion,et al.  Application of neural networks to the classification of giant cell arteritis. , 1994, Arthritis and rheumatism.

[16]  J. Hedges,et al.  Decision rules and clinical prediction of pneumonia: evaluation of low-yield criteria. , 1989, Annals of emergency medicine.

[17]  J V Tu,et al.  Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. , 1996, Journal of clinical epidemiology.

[18]  Bruce W. Colletti,et al.  Artificial intelligence versus logistic regression statistical modelling to predict cardiac complications after noncardiac surgery , 1994, Clinical Cardiology.

[19]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[20]  Halbert White,et al.  Bootstrapping Confidence Intervals for Clinical Input Variable Effects in a Network Trained to Identify the Presence of Acute Myocardial Infarction , 1995, Neural Computation.

[21]  P. Wilding,et al.  The application of backpropagation neural networks to problems in pathology and laboratory medicine. , 1992, Archives of pathology & laboratory medicine.

[22]  James A. Freeman,et al.  Simulating neural networks - with Mathematica , 1993 .

[23]  K. R. Hammond,et al.  ANALYZING THE COMPONENTS OF CLINICAL INFERENCE. , 1964, Psychological review.

[24]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[25]  E. Somoza,et al.  A Neural-network Approach to Predicting Admission Decisions in a Psychiatric Emergency Room , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  E. Brunswik Perception and the Representative Design of Psychological Experiments , 1957 .

[27]  L. Tucker A SUGGESTED ALTERNATIVE FORMULATION IN THE DEVELOPMENTS BY HURSCH, HAMMOND, AND HURSCH, AND BY HAMMOND, HURSCH, AND TODD. , 1964, Psychological review.

[28]  A Gottschalk,et al.  A Comparison of Human and Machine-based Predictions of Successful Weaning from Mechanical Ventilation , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[29]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[30]  Ira L. Cohen,et al.  A neural network approach to the classification of autism , 1993, Journal of autism and developmental disorders.

[31]  C A Hernández,et al.  How to choose the training data for neural network medical diagnosis systems. , 1993, Biomedical sciences instrumentation.

[32]  W. Baxt Use of an artificial neural network for the diagnosis of myocardial infarction. , 1991, Annals of internal medicine.

[33]  R. Dybowski,et al.  Prediction of outcome in critically ill patients using artificial neural network synthesised by genetic algorithm , 1996, The Lancet.

[34]  Lawrence S. Kroll Mathematica--A System for Doing Mathematics by Computer. , 1989 .

[35]  William G. Baxt A neural network trained to identify the presence of myocardial infarction bases diagnostic decision on nonlinear relationships between input variables , 2005, Neural Computing & Applications.

[36]  J P Ornato,et al.  Use of Clinical Judgment Analysis to Explain Regional Variations in Physicians' Accuracies in Diagnosing Pneumonia , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  W Penny,et al.  Neural Networks in Clinical Medicine , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[38]  D. E. Peake Decision rules and clinical prediction of pneumonia: Evaluation of low yield criteria , 1989 .

[39]  D. Dorfman,et al.  Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data , 1969 .