Dynamic Prediction in Clinical Survival Analysis Using Temporal Convolutional Networks

Accurate prediction of disease trajectories is critical for early identification and timely treatment of patients at risk. Conventional methods in survival analysis are often constrained by strong parametric assumptions and limited in their ability to learn from high-dimensional data. This paper develops a novel convolutional approach that addresses the drawbacks of both traditional statistical approaches as well as recent neural network models for survival. We present Match-Net: a missingness-aware temporal convolutional hitting-time network, designed to capture temporal dependencies and heterogeneous interactions in covariate trajectories and patterns of missingness. To the best of our knowledge, this is the first investigation of temporal convolutions in the context of dynamic prediction for personalized risk prognosis. Using real-world data from the Alzheimer's disease neuroimaging initiative, we demonstrate state-of-the-art performance without making any assumptions regarding underlying longitudinal or time-to-event processes—attesting to the model's potential utility in clinical decision support.

[1]  L. Mariani,et al.  Prognostic factors for metachronous contralateral breast cancer: A comparison of the linear Cox regression model and its artificial neural network extension , 1997, Breast Cancer Research and Treatment.

[2]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[3]  Li Su,et al.  Dynamic predictions using flexible joint models of longitudinal and time‐to‐event data , 2017, Statistics in medicine.

[4]  Yorghos Tripodis,et al.  A COMPARISON BETWEEN MIXED EFFECT AND JOINT MODELS FOR SURVIVAL AND LONGITUDINAL MODEL ESTIMATES , 2017, Alzheimer's & Dementia.

[5]  Padraig Cunningham,et al.  The problem of bias in training data in regression problems in medical decision support , 2002, Artif. Intell. Medicine.

[6]  G. Rodŕıguez,et al.  Parametric Survival Models , 2010 .

[7]  K. Liestøl,et al.  Survival analysis and neural nets. , 1994, Statistics in medicine.

[8]  Danielle J. Harvey,et al.  The Alzheimer's Disease Neuroimaging Initiative phase 2: Increasing the length, breadth, and depth of our understanding , 2015, Alzheimer's & Dementia.

[9]  Daniel C. Alexander,et al.  Disease Knowledge Transfer across Neurodegenerative Diseases , 2019, MICCAI.

[10]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[11]  Yingye Zheng,et al.  Partly Conditional Survival Models for Longitudinal Data , 2005, Biometrics.

[12]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[13]  I. James,et al.  Linear regression with censored data , 1979 .

[14]  K. Doksum,et al.  Models for Variable-Stress Accelerated Life Testing Experiments Based on Wiener Processes and the Inverse Gaussian Distribution , 1992 .

[15]  J D Kalbfleisch,et al.  Hazard rate models with covariates. , 1979, Biometrics.

[16]  Sid E O'Bryant,et al.  Staging dementia using Clinical Dementia Rating Scale Sum of Boxes scores: a Texas Alzheimer's research consortium study. , 2008, Archives of neurology.

[17]  Sanjay Purushotham,et al.  Survival outcome prediction in cervical cancer: Cox models vs deep‐learning model , 2019, American journal of obstetrics and gynecology.

[18]  Yoshua Bengio,et al.  Deep Learning for Patient-Specific Kidney Graft Survival Analysis , 2017, ArXiv.

[19]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[20]  Mihaela van der Schaar,et al.  MATCH-Net: Dynamic Prediction in Survival Analysis using Convolutional Neural Networks , 2018, ArXiv.

[21]  Manhua Liu,et al.  Hippocampus Analysis by Combination of 3-D DenseNet and Shapes for Alzheimer's Disease Diagnosis , 2019, IEEE Journal of Biomedical and Health Informatics.

[22]  Changhee Lee,et al.  Dynamic-DeepHit: A Deep Learning Approach for Dynamic Survival Analysis With Competing Risks Based on Longitudinal Data , 2020, IEEE Transactions on Biomedical Engineering.

[23]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[24]  Nick C Fox,et al.  TADPOLE Challenge: Prediction of Longitudinal Evolution in Alzheimer's Disease. , 2018, 1805.03909.

[25]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[26]  Kai Yang,et al.  A Deep Active Survival Analysis Approach for Precision Treatment Recommendations: Application of Prostate Cancer , 2018, Expert Syst. Appl..

[27]  D Faraggi,et al.  A neural network model for survival data. , 1995, Statistics in medicine.

[28]  Changhee Lee,et al.  DeepHit: A Deep Learning Approach to Survival Analysis With Competing Risks , 2018, AAAI.

[29]  Ping Wang,et al.  Machine Learning for Survival Analysis , 2019, ACM Comput. Surv..

[30]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[31]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[32]  Russell Greiner,et al.  Learning Patient-Specific Cancer Survival Distributions as a Sequence of Dependent Regressors , 2011, NIPS.

[33]  Mihaela van der Schaar,et al.  Forecasting Disease Trajectories in Alzheimer's Disease Using Deep Learning , 2018, ArXiv.

[34]  Graeme L. Hickey,et al.  Joint modelling of time-to-event and multivariate longitudinal outcomes: recent developments and issues , 2016, BMC Medical Research Methodology.

[35]  Bo Zhang,et al.  Joint Modeling of Transitional Patterns of Alzheimer's Disease , 2013, PloS one.

[36]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[37]  Jerzy W. Grzymala-Busse,et al.  An Approach to Imbalanced Data Sets Based on Changing Rule Strength , 2004, Rough-Neural Computing: Techniques for Computing with Words.

[38]  Sheng Luo,et al.  Functional joint model for longitudinal and time‐to‐event data: an application to Alzheimer's disease , 2017, Statistics in medicine.

[39]  Yee Whye Teh,et al.  Gaussian Processes for Survival Analysis , 2016, NIPS.

[40]  Pedro Rosa-Neto,et al.  Synergistic interaction between amyloid and tau predicts the progression to dementia , 2017, Alzheimer's & Dementia.

[41]  G. A. Whitmore,et al.  Proportional hazards and threshold regression: their theoretical and practical connections , 2010, Lifetime data analysis.

[42]  Elia Biganzoli,et al.  Partial logistic artificial neural networks (PLANN) for flexible modeling of censored survival data , 2009, 2009 International Joint Conference on Neural Networks.

[43]  H. V. Houwelingen Dynamic Prediction by Landmarking in Event History Analysis , 2007 .

[44]  Abdulhamit Subasi,et al.  Automatic Detection of Alzheimer Disease Based on Histogram and Random Forest , 2019, IFMBE Proceedings.

[45]  Qiongling Li,et al.  Correlation-Aware Sparse and Low-Rank Constrained Multi-Task Learning for Longitudinal Analysis of Alzheimer's Disease , 2019, IEEE Journal of Biomedical and Health Informatics.

[46]  Jerry L. Prince,et al.  A computational neurodegenerative disease progression score: Method and results with the Alzheimer's disease neuroimaging initiative cohort , 2012, NeuroImage.

[47]  Ben Glocker,et al.  Disease prediction using graph convolutional networks: Application to Autism Spectrum Disorder and Alzheimer's disease , 2018, Medical Image Anal..

[48]  P. Grambsch,et al.  A Package for Survival Analysis in S , 1994 .

[49]  Yuanyuan Qin,et al.  Detecting Alzheimer's Disease on Small Dataset: A Knowledge Transfer Perspective , 2019, IEEE Journal of Biomedical and Health Informatics.

[50]  Dimitris Rizopoulos,et al.  Joint Models for Longitudinal and Time-to-Event Data: With Applications in R , 2012 .

[51]  for the Alzheimer’s Disease Neuroimaging Initiative Predicting Alzheimer’s disease progression using multi-modal deep learning approach , 2019 .

[52]  Hélène Jacqmin-Gadda,et al.  Estimating long-term multivariate progression from short-term data , 2014, Alzheimer's & Dementia.

[53]  W. M. van der Flier,et al.  Prevalence and prognosis of Alzheimer's disease at the mild cognitive impairment stage. , 2015, Brain : a journal of neurology.

[54]  H. Putter,et al.  Dynamic Prediction in Clinical Survival Analysis , 2011 .

[55]  Sterling C. Johnson,et al.  Predicting Alzheimer’s disease progression using multi-modal deep learning approach , 2019, Scientific Reports.

[56]  J. Hardy,et al.  The Amyloid Hypothesis of Alzheimer ’ s Disease : Progress and Problems on the Road to Therapeutics , 2009 .

[57]  Lang Wu,et al.  Mixed Effects Models for Complex Data , 2019 .

[58]  R. Singh,et al.  Survival analysis in clinical trials: Basics and must know areas , 2011, Perspectives in clinical research.

[59]  Ahmed M. Alaa,et al.  Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks , 2017, NIPS.

[60]  Junzhou Huang,et al.  Deep convolutional neural network for survival analysis with pathological images , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[61]  Xun Zhu,et al.  Cox-nnet: An artificial neural network method for prognosis prediction of high-throughput omics data , 2018, PLoS Comput. Biol..

[62]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[63]  R. Coleman,et al.  Neuroimaging and early diagnosis of Alzheimer disease: a look to the future. , 2003, Radiology.

[64]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Anastasios A. Tsiatis,et al.  Joint Modeling of Longitudinal and Time-to-Event Data : An Overview , 2004 .

[66]  P. Lapuerta,et al.  Comparison of the performance of neural network methods and Cox regression for censored survival data , 2000 .

[67]  David G. Kleinbaum,et al.  Parametric Survival Models , 2012 .