Time-series deep survival prediction for hemodialysis patients using an attention-based Bi-GRU network

BACKGROUND AND OBJECTIVE The number of end-stage renal disease (ESRD) patients treated with hemodialysis (HD) has significantly increased, but the prognosis remains poor. Time-series features have been included in only a few studies to predict HD patient survival, and how to utilize such features effectively remains unclear. This article aims to develop a more accurate, interpretable, and clinically practical personalized survival prediction model for HD patients. METHODS This study proposed and evaluated an attention-based Bi-GRU network using time-series features for survival prediction. A distance-based loss function was proposed to improve performance. We used data from 1232 ESRD patients who received regular hemodialysis treatment for ≥ 3 months from 2007 to 2016 at the First Affiliated Hospital of Zhejiang University. The proposed model was compared with representative sequence modeling deep learning architectures and existing survival analysis methods in terms of the C-index and IBS value. Post hoc tests were used to test statistical significance. The attention map was used to assess feature importance over time. The impact of time-series changes on survival was investigated after controlling initial values (using BMI as an example). RESULTS The proposed method outperformed other sequence modeling architectures and the state-of-the-art survival analysis approaches in terms of the C-index and the integrated Brier score (IBS) value. Our method achieved a C-index of 0.7680 (95% confidence intervals [CI]: 0.7645, 0.7716) and an IBS of 0.1302 (95% confidence intervals [CI]: 0.1292, 0.1313), showing an improvement of up to 5.4% in terms of the C-index and a decrease of 3.2% in terms of the IBS value. The addition of the distance-based loss function improved the performance. The predicted risk and actual risk levels closely agreed. This study also found that even after controlling the initial body mass index (BMI) values, different 3-month BMI trends could produce different survival outcomes. CONCLUSIONS This study proposed a more effective and interpretable method to use time-series information in survival analysis. The proposed method may help promote personalized medicine and improve patient prognosis.

[1]  Lawrence Carin,et al.  Adversarial Time-to-Event Modeling , 2018, ICML.

[2]  C. L. Yau,et al.  Body mass index and risk of ESRD in China. , 2007, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[3]  Changhee Lee,et al.  DeepHit: A Deep Learning Approach to Survival Analysis With Competing Risks , 2018, AAAI.

[4]  Junzhou Huang,et al.  Deep convolutional neural network for survival analysis with pathological images , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[5]  Jieping Ye,et al.  A Multi-Task Learning Formulation for Survival Analysis , 2016, KDD.

[6]  N. Simon,et al.  Survival Prediction Using Deep Learning , 2021, SPACA.

[7]  C. Lok,et al.  Clinical Epidemiology of Cardiovascular Disease in Chronic Kidney Disease , 2005, Nephron Clinical Practice.

[8]  S. Chiu,et al.  The Impact of Vascular Access Types on Hemodialysis Patient Long-term Survival , 2019, Scientific Reports.

[9]  D.,et al.  Regression Models and Life-Tables , 2022 .

[10]  Mihaela van der Schaar,et al.  RNN-SURV: A Deep Recurrent Model for Survival Analysis , 2018, ICANN.

[11]  Simone A. Ludwig,et al.  Performance Evaluation of Deep Neural Networks Applied to Speech Recognition: RNN, LSTM and GRU , 2019, J. Artif. Intell. Soft Comput. Res..

[12]  Hemant Ishwaran,et al.  Random Survival Forests , 2008, Wiley StatsRef: Statistics Reference Online.

[13]  Yu Wang,et al.  Pattern recognition and prognostic analysis of longitudinal blood pressure records in hemodialysis treatment based on a convolutional neural network , 2019, J. Biomed. Informatics.

[14]  E Graf,et al.  Assessment and comparison of prognostic classification schemes for survival data. , 1999, Statistics in medicine.

[15]  H. Morgenstern,et al.  Projecting ESRD Incidence and Prevalence in the United States through 2030. , 2019, Journal of the American Society of Nephrology : JASN.

[16]  Ida Scheel,et al.  Time-to-Event Prediction with Neural Networks and Cox Regression , 2019, J. Mach. Learn. Res..

[17]  N. Breslow Covariance analysis of censored survival data. , 1974, Biometrics.

[18]  M. Mitsnefes,et al.  Cardiovascular disease in young adults with incident ESRD , 2019, Nature Reviews Nephrology.

[19]  R. Écochard,et al.  Impact of BMI Variations on Survival in Elderly Hemodialysis Patients. , 2015, Journal of renal nutrition : the official journal of the Council on Renal Nutrition of the National Kidney Foundation.

[20]  C. Nam,et al.  Dialysis adequacy predictions using a machine learning method , 2021, Scientific Reports.

[21]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[22]  Balaji Krishnapuram,et al.  On Ranking in Survival Analysis: Bounds on the Concordance Index , 2007, NIPS.

[23]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[24]  D Faraggi,et al.  A neural network model for survival data. , 1995, Statistics in medicine.

[25]  H. Morgenstern,et al.  US Renal Data System 2019 Annual Data Report: Epidemiology of Kidney Disease in the United States. , 2019, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[26]  Joshua E. Lewis,et al.  Predicting clinical outcomes from large scale cancer genomic profiles with deep survival models , 2017, Scientific Reports.

[27]  Julia E. Vogt,et al.  A Deep Variational Approach to Clustering Survival Data , 2021, ArXiv.

[28]  B. Epureanu,et al.  Application of explainable ensemble artificial intelligence model to categorization of hemodialysis-patient and treatment using nationwide-real-world data in Japan , 2020, PloS one.

[29]  Changhee Lee,et al.  Dynamic-DeepHit: A Deep Learning Approach for Dynamic Survival Analysis With Competing Risks Based on Longitudinal Data , 2020, IEEE Transactions on Biomedical Engineering.

[30]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[31]  Mee Young Park,et al.  L1‐regularization path algorithm for generalized linear models , 2007 .

[32]  Kai Heinrich,et al.  Process data properties matter: Introducing gated convolutional neural networks (GCNN) and key-value-predict attention networks (KVP) for next event prediction with deep learning , 2021, Decis. Support Syst..

[33]  Ping Zhang,et al.  Intradialytic blood pressure pattern recognition based on density peak clustering , 2018, J. Biomed. Informatics.

[34]  K. Johansen,et al.  Pre-ESRD changes in body weight and survival in nursing home residents starting dialysis. , 2013, Clinical journal of the American Society of Nephrology : CJASN.

[35]  M. Samore,et al.  Effects of body size and body composition on survival in hemodialysis patients. , 2003, Journal of the American Society of Nephrology : JASN.

[36]  D. Lin,et al.  On the Breslow estimator , 2007, Lifetime data analysis.

[37]  Alex Sherstinsky,et al.  Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network , 2018, Physica D: Nonlinear Phenomena.

[38]  I. Cha,et al.  Deep learning-based survival prediction of oral cancer patients , 2019, Scientific Reports.

[39]  Bernd Bischl,et al.  Visualizing the Feature Importance for Black Box Models , 2018, ECML/PKDD.

[40]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[41]  Ricardo Henao,et al.  Variational learning of individual survival distributions , 2020, CHIL.

[42]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[43]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .