Comparison of Cox regression with other methods for determining prediction models and nomograms.

PURPOSE There is controversy as to whether artificial neural networks and other machine learning methods provide predictions that are more accurate than those provided by traditional statistical models when applied to censored data. MATERIALS AND METHODS Several machine learning prediction methods are compared with Cox proportional hazards regression using 3 large urological datasets. As a measure of predictive ability, discrimination that is similar to an area under the receiver operating characteristic curve is computed for each. RESULTS In all 3 datasets Cox regression provided comparable or superior predictions compared with neural networks and other machine learning techniques. In general, this finding is consistent with the literature. CONCLUSIONS Although theoretically attractive, artificial neural networks and other machine learning techniques do not often provide an improvement in predictive accuracy over Cox regression.

[1]  F. Harrell,et al.  Evaluating the yield of medical tests. , 1982, JAMA.

[2]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[3]  Mark R. Segal,et al.  Regression Trees for Censored Data , 1988 .

[4]  P. Grambsch,et al.  Martingale-based residuals for survival models , 1990 .

[5]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[6]  J R Beck,et al.  Experiments to determine whether recursive partitioning (CART) or an artificial neural network overcomes theoretical limitations of Cox proportional hazards regression. , 1998, Computers and biomedical research, an international journal.

[7]  Michael W. Kattan,et al.  The predictive accuracy of computer-based classification decision techniques.A review and research directions , 1998 .

[8]  Michael W. Kattan,et al.  A simulation of factors affecting machine learning techniques: an examination of partitioning and class proportions , 2000 .

[9]  C. Begg,et al.  Comparing tumour staging and grading systems: a case study and a review of the issues, using thymoma as a model. , 2000, Statistics in medicine.

[10]  M W Kattan,et al.  Pretreatment nomogram for predicting the outcome of three-dimensional conformal radiotherapy in prostate cancer. , 2000, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[11]  M. Kattan,et al.  A postoperative prognostic nomogram for renal cell carcinoma. , 2001, The Journal of urology.

[12]  M W Kattan,et al.  A catalog of prostate cancer nomograms. , 2001, The Journal of urology.

[13]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[14]  D. Sargent,et al.  Comparison of artificial neural networks with other statistical approaches , 2001, Cancer.

[15]  Brian D. Ripley,et al.  Clinical applications of artificial neural networks: Neural networks as statistical methods in survival analysis , 2001 .

[16]  J. Blasko,et al.  Pretreatment nomogram for predicting freedom from recurrence after permanent prostate brachytherapy in prostate cancer. , 2001, Urology.

[17]  Guido Schwarzer,et al.  Artificial neural networks for diagnosis and prognosis in prostate cancer. , 2002, Seminars in urologic oncology.