Survival analysis in cancer using a partial logistic neural network model with Bayesian regularisation framework: a validation study

This paper describes a multicentre longitudinal cohort study to evaluate the predictive accuracy of a regularised Bayesian neural network model in a prognostic application. The study sample (n = 5442) comprises subjects treated with intraocular melanoma in two different centres in Liverpool and Paris. External validation was carried out by fitting the model to the data from Liverpool set and predicting for the data from Paris. The performance of the model in out-of-sample prediction was assessed statistically for discrimination of outcomes and calibration. It was also evaluated clinically by comparing against the accepted TNM staging system. The model had good discrimination with Harrell's C index > 0.7 up to ten years of follow-up. Calibration results were also good up to ten years using a Hosmer-Lemeshow type analysis (p > 0.05). The paper: 1) deals with the issue of missing data using methods that are well accepted in the literature; 2) proposes a framework for externally validating machine learning models applied to survival analysis; 3) applies accepted methods for dealing with missing data; 4) proposes an alternative staging system based on the model. The new staging system, which takes into account histopathologic information, has several advantages over the existing staging system.

[1]  Paulo J. G. Lisboa,et al.  A Bayesian neural network approach for modelling censored data with an application to prognosis after surgery for breast cancer , 2003, Artif. Intell. Medicine.

[2]  E Biganzoli,et al.  Feed forward neural networks for the analysis of censored survival data: a partial logistic regression approach. , 1998, Statistics in medicine.

[3]  Antonio Eleuteri,et al.  Artificial neural networks estimating survival probability after treatment of choroidal melanoma. , 2008, Ophthalmology.

[4]  Paulo J. G. Lisboa,et al.  A review of evidence of health benefit from artificial neural networks in medical intervention , 2002, Neural Networks.

[5]  Pierre Validire,et al.  Histopathologic risk factors in retinoblastoma: A retrospective study of 172 patients treated in a single institution , 1996, Cancer.

[6]  Ralph B. D'Agostino,et al.  Evaluation of the Performance of Survival Analysis Models: Discrimination and Calibration Measures , 2003, Advances in Survival Analysis.

[7]  D. Mackay,et al.  Bayesian methods for adaptive models , 1992 .

[8]  Tero Kivelä,et al.  Tumor, node, metastasis classification of malignant ciliary body and choroidal melanoma evaluation of the 6th edition and future directions. , 2005, Ophthalmology.

[9]  Matthias May,et al.  Validity of the CAPRA score to predict biochemical recurrence-free survival after radical prostatectomy. Results from a european multicenter survey of 1,296 patients. , 2007, The Journal of urology.

[10]  Lucila Ohno-Machado,et al.  Logistic regression and artificial neural network classification models: a methodology review , 2002, J. Biomed. Informatics.

[11]  F. Harrell,et al.  Evaluating the yield of medical tests. , 1982, JAMA.

[12]  Sabine Van Huffel,et al.  External Validation of Mathematical Models to Distinguish Between Benign and Malignant Adnexal Tumors: A Multicenter Study by the International Ovarian Tumor Analysis Group , 2007, Clinical Cancer Research.

[13]  H. Boshuizen,et al.  Multiple imputation of missing blood pressure covariates in survival analysis. , 1999, Statistics in medicine.

[14]  Paulo J. G. Lisboa,et al.  The Use of Artificial Neural Networks in Decision Support in Cancer: a Systematic Review , 2005 .

[15]  J P Donohue,et al.  Prediction of residual retroperitoneal mass histology after chemotherapy for metastatic nonseminomatous germ cell tumor: multivariate analysis of individual patient data from six study groups. , 1995, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[16]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[17]  Antonio Eleuteri,et al.  A web-based tool for the assessment of discrimination and calibration properties of prognostic models , 2008, Comput. Biol. Medicine.

[18]  T. Hakulinen,et al.  Mixture models for cancer survival analysis: application to population-based data with covariates. , 1999, Statistics in medicine.