Relevance Vector Machine for Survival Analysis

An accelerated failure time (AFT) model has been widely used for the analysis of censored survival or failure time data. However, the AFT imposes the restrictive log-linear relation between the survival time and the explanatory variables. In this paper, we introduce a relevance vector machine survival (RVMS) model based on Weibull AFT model that enables the use of kernel framework to automatically learn the possible nonlinear effects of the input explanatory variables on target survival times. We take advantage of the Bayesian inference technique in order to estimate the model parameters. We also introduce two approaches to accelerate the RVMS training. In the first approach, an efficient smooth prior is employed that improves the degree of sparsity. In the second approach, a fast marginal likelihood maximization procedure is used for obtaining a sparse solution of survival analysis task by sequential addition and deletion of candidate basis functions. These two approaches, denoted by smooth RVMS and fast RVMS, typically use fewer basis functions than RVMS and improve the RVMS training time; however, they cause a slight degradation in the RVMS performance. We compare the RVMS and the two accelerated approaches with the previous sparse kernel survival analysis method on a synthetic data set as well as six real-world data sets. The proposed kernel survival analysis models have been discovered to be more accurate in prediction, although they benefit from extra sparsity. The main advantages of our proposed models are: 1) extra sparsity that leads to a better generalization and avoids overfitting; 2) automatic relevance sample determination based on data that provide more accuracy, in particular for highly censored survival data; and 3) flexibility to utilize arbitrary number and types of kernel functions (e.g., non-Mercer kernels and multikernel learning).

[1]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  De-Shuang Huang,et al.  The Forecast of the Postoperative Survival Time of Patients Suffered from Non-small Cell Lung Cancer Based on Pca and Extreme Learning Machine , 2006, Int. J. Neural Syst..

[3]  R. Kay The Analysis of Survival Data , 2012 .

[4]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Gavin C. Cawley,et al.  Sparse bayesian kernel survival analysis for modeling the growth domain of microbial pathogens , 2006, IEEE Transactions on Neural Networks.

[6]  Joseph N. Wilson,et al.  A Bayesian approach to localized multi-kernel learning using the relevance vector machine , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Sabine Van Huffel,et al.  Survival SVM: a practical scalable algorithm , 2008, ESANN.

[8]  Elia Biganzoli,et al.  A general framework for neural network models on censored survival data , 2002, Neural Networks.

[9]  Elia Biganzoli,et al.  Partial logistic relevance vector machines in survival analysis , 2011 .

[10]  Nikolas P. Galatsanos,et al.  Large Scale Multikernel Relevance Vector Machine for Object Detection , 2007, Int. J. Artif. Intell. Tools.

[11]  Michael E. Tipping,et al.  Analysis of Sparse Bayesian Learning , 2001, NIPS.

[12]  Ian T. Nabney,et al.  Efficient Training Of Rbf Networks For Classification , 2004, Int. J. Neural Syst..

[13]  Richard M. Everson,et al.  Smooth relevance vector machine: a smoothness prior extension of the RVM , 2007, Machine Learning.

[14]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[15]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[16]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[17]  Bert Kappen,et al.  Improving Cox survival analysis with a neural‐Bayesian approach , 2004, Statistics in medicine.

[18]  Katya Scheinberg,et al.  Efficient SVM Training Using Low-Rank Kernel Representations , 2002, J. Mach. Learn. Res..

[19]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[20]  Faisal M. Khan,et al.  Support Vector Regression for Censored Data (SVRc): A Novel Tool for Survival Analysis , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[21]  Sabine Van Huffel,et al.  Support vector methods for survival analysis: a comparison between ranking and regression approaches , 2011, Artif. Intell. Medicine.

[22]  Yalda Mohsenzadeh,et al.  Gaussian Kernel Width Optimization for Sparse Bayesian Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[23]  David J. C. MacKay,et al.  The Evidence Framework Applied to Classification Networks , 1992, Neural Computation.

[24]  B. Hankey,et al.  Surveillance, Epidemiology, and End Results Program , 1999 .

[25]  B. Hankey,et al.  The surveillance, epidemiology, and end results program: a national resource. , 1999, Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology.

[26]  Wei Chu,et al.  A Support Vector Approach to Censored Targets , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[27]  Bart De Moor,et al.  Development of a kernel function for clinical data , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Sabine Van Huffel,et al.  Support vector machines for survival analysis , 2007 .

[29]  Mário A. T. Figueiredo Adaptive Sparseness for Supervised Learning , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Ludger Evers,et al.  Sparse kernel methods for high-dimensional survival data , 2008, Bioinform..

[31]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[32]  Roberto Tagliaferri,et al.  A novel neural network-based survival analysis model , 2003, Neural Networks.