A comparison of Cox proportional hazards and artificial neural network models for medical prognosis

Modeling survival of populations and establishing prognoses for individual patients are important activities in the practice of medicine. For patients with diseases that may extend for several years, in particular, accurate assessment of survival probabilities is essential. New methods, such as neural networks, have been used increasingly to model disease progression. Their advantages and disadvantages, when compared to statistical methods such as Cox proportional hazards, have seldom been explored in real-world data. In this study, we compare the performances of a Cox model and a neural network model that are used as prognostic tools for a set of people living with AIDS. We modeled disease progressions for patients who had AIDS (according to the 1993 CDC definition) in a set of 588 patients in California, using data from the ATHOS project. We divided the study population into 10 training and 10 test sets and evaluated the prognostic accuracy of a Cox proportional hazards model and of a neural network model by determining sensitivities, specificities, positive and negative predictive values for an arbitrary threshold (0.5), and the areas under the receiver operating characteristics (ROC) curves that utilized all possible thresholds for intervals of 1 yr following the diagnosis of AIDS. There was no evidence that the Cox model performed better than did the neural network model or vice versa, but the former method had the advantage of providing some insight on which variables were most influential for prognosis. Nevertheless, it is likely that the assumptions required by the Cox model may not be satisfied in all data sets, justifying the use of neural networks in certain cases.

[1]  David R. Cox The analysis of binary data , 1970 .

[2]  D. D. Ingram,et al.  Empirical comparisons of proportional hazards and logistic regression models. , 1989, Statistics in medicine.

[3]  K. Mehrotra,et al.  Prediction criteria for successful weaning from respiratory support: Statistical and connectionist analyses , 1992, Critical care medicine.

[4]  David E. Rumelhart,et al.  MSnet: A Neural Network which Classifies Mass Spectra , 1990 .

[5]  D. Cox,et al.  Analysis of Survival Data. , 1985 .

[6]  John W. Ward,et al.  1993 revised classification system for HIV infection and expanded surveillance case definition for AIDS among adolescents and adults. , 1993, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[7]  J F Fries,et al.  Health status among persons infected with human immunodeficiency virus. A community-based study. , 1993, Medical care.

[8]  C. Horsburgh,et al.  Survival prognosis of HIV-infected patients. , 1993, Journal of acquired immune deficiency syndromes.

[9]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[10]  M A Musen,et al.  Hierarchical neural networks for survival analysis. , 1995, Medinfo. MEDINFO.

[11]  S Mitchell,et al.  Predicting Outcomes After Liver Transplantation A Connectionist Approach , 1994, Annals of surgery.

[12]  S. Glantz,et al.  Primer of Applied Regression & Analysis of Variance , 1990 .

[13]  A R Feinstein,et al.  A new prognostic staging system for the acquired immunodeficiency syndrome. , 1989, The New England journal of medicine.

[14]  P. Lapuerta,et al.  Use of neural networks in predicting the risk of coronary artery disease. , 1995, Computers and biomedical research, an international journal.

[15]  A M Epstein,et al.  Effect of changing patterns of care and duration of survival on the cost of treating the acquired immunodeficiency syndrome (AIDS). , 1990, American journal of public health.

[16]  M A Musen,et al.  A comparison of two computer-based prognostic systems for AIDS. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[17]  James L. McClelland Explorations In Parallel Distributed Processing , 1988 .

[18]  H. Kappen,et al.  Neural network analysis to predict treatment outcome , 1993 .

[19]  David Collett Modelling Survival Data in Medical Research , 1994 .

[20]  H. Burke,et al.  Artificial neural networks for cancer research: outcome prediction. , 1994, Seminars in surgical oncology.

[21]  Mark A. Musen,et al.  Modular Neural Networks for Medical Prognosis: Quantifying the Benefits of Combining Neural Networks for Survival Prediction , 1997, Connect. Sci..

[22]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[23]  M. Rotondo,et al.  A new approach to probability of survival scoring for trauma quality assurance. , 1992, The Journal of trauma.

[24]  M. Ebell Artificial neural networks for predicting failure to survive following in-hospital cardiopulmonary resuscitation. , 1993, The Journal of family practice.