Enhanced prediction of hemoglobin concentration in a very large cohort of hemodialysis patients by means of deep recurrent neural networks

Erythropoiesis Stimulating Agents (ESAs) have become a standard anemia management tool for End Stage Renal Disease (ESRD) patients. However, dose optimization constitutes an extremely challenging task due to huge inter and intra-patient variability in the responses to ESA administration. Current data-based approaches to anemia control focus on learning accurate hemoglobin prediction models, which can be later utilized for testing competing treatment choices and choosing the optimal one. These methods, despite being proven effective in practice, present several shortcomings which this paper intends to tackle. Namely, they are limited to a small cohort of patients and, even then, they fail to provide suggestions when some strict requirements are not met (such as having a three month history prior to the prediction). Here, recurrent neural networks (RNNs) are used to model whole patient histories, providing predictions at every time step since the very first day. Furthermore, an unprecedented amount of data (∼110,000 patients from many different medical centers in twelve countries, without exclusion criteria) was used to train it, thus allowing it to generalize for every single patient. The resulting model outperforms state-of-the-art Hemoglobin prediction, providing excellent results even when tested on a prospective dataset. Simultaneously, it allows to bring the benefits of algorithmic anemia control to a very large group of patients.

[1]  José David Martín-Guerrero,et al.  A new machine learning approach for predicting the response to anemia treatment in a large cohort of End Stage Renal Disease patients undergoing dialysis , 2015, Comput. Biol. Medicine.

[2]  SchmidhuberJürgen,et al.  2005 Special Issue , 2005 .

[3]  Antonio J. Serrano,et al.  Dosage individualization of erythropoietin using a profile-dependent support vector regression , 2003, IEEE Transactions on Biomedical Engineering.

[4]  Vittorio E. Andreucci,et al.  Regimen Complexity and Prescription Adherence in Dialysis Patients , 2011, American Journal of Nephrology.

[5]  Carmine Zoccali,et al.  International differences in chronic kidney disease prevalence: a key public health and epidemiologic research issue: Clinical Epidemiology in Nephrology , 2017, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[6]  Stephen Jan,et al.  How can we achieve global equity in provision of renal replacement therapy? , 2008, Bulletin of the World Health Organization.

[7]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[8]  S. Rai,et al.  Individualized anemia management reduces hemoglobin variability in hemodialysis patients. , 2014, Journal of the American Society of Nephrology : JASN.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[11]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[12]  Peter Kotanko,et al.  Prediction of hemoglobin levels in individual hemodialysis patients by means of a mathematical model of erythropoiesis , 2018, PloS one.

[13]  Chi Pang Wen,et al.  Chronic kidney disease and cardiovascular risk: epidemiology, mechanisms, and prevention , 2013, The Lancet.

[14]  Wim Van Biesen,et al.  Cost of renal replacement: how to help as many as possible while keeping expenses reasonable? , 2016, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[15]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Jacek M. Zurada,et al.  Individualization of pharmacological anemia management using reinforcement learning , 2005, Neural Networks.

[17]  M. Brier,et al.  Model predictive control of erythropoietin administration in the anemia of ESRD. , 2008, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[18]  B. Canaud,et al.  An international observational study suggests that artificial intelligence for clinical decision support optimizes anemia management in hemodialysis patients. , 2016, Kidney international.

[19]  Daniel E Weiner,et al.  Computerized decision support for EPO dosing in hemodialysis patients. , 2009, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[20]  S. Fishbane,et al.  Evidence and implications of haemoglobin cycling in anaemia management. , 2007, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[21]  Walter F. Stewart,et al.  Doctor AI: Predicting Clinical Events via Recurrent Neural Networks , 2015, MLHC.

[22]  J. Tattersall,et al.  A predictive algorithm for the management of anaemia in haemodialysis patients based on ESA pharmacodynamics: better results for less work. , 2012, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[23]  I. Macdougall,et al.  Performance of a Predictive Model for Long-Term Hemoglobin Response to Darbepoetin and Iron Administration in a Large Cohort of Hemodialysis Patients , 2016, PloS one.

[24]  José David Martín-Guerrero,et al.  Optimization of anemia treatment in hemodialysis patients via reinforcement learning , 2014, Artif. Intell. Medicine.

[25]  Douglas E Schaubel,et al.  US Renal Data System 2017 Annual Data Report: Epidemiology of Kidney Disease in the United States. , 2018, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[26]  Adam E. Gaweda,et al.  Model Predictive Control with Reinforcement Learning for Drug Delivery in Renal Anemia Management , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Joseph Horowitz,et al.  The greatly misunderstood erythropoietin resistance index and the case for a new responsiveness measure , 2016, Hemodialysis international. International Symposium on Home Hemodialysis.

[28]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[29]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[30]  Raymond Vanholder,et al.  Renal replacement therapy: how can we contain the costs? , 2014, The Lancet.

[31]  R. Bellazzi,et al.  Mathematical modeling of erythropoietin therapy in uremic anemia. Does it improve cost-effectiveness? , 1994, Haematologica.

[32]  S. Fishbane,et al.  Hemoglobin cycling in hemodialysis patients treated with recombinant human erythropoietin. , 2005, Kidney international.

[33]  M. J. Andersen,et al.  The coming fiscal crisis: nephrology in the line of fire. , 2013, Clinical journal of the American Society of Nephrology : CJASN.

[34]  Yot Teerawattananon,et al.  How to meet the demand for good quality renal dialysis as part of universal health coverage in resource-limited settings? , 2016, Health Research Policy and Systems.

[35]  J. Sedor,et al.  Chronic kidney disease and its complications. , 2008, Primary care.

[36]  M. Brier,et al.  Personalized Anemia Management and Precision Medicine in ESA and Iron Pharmacology in End-Stage Kidney Disease. , 2018, Seminars in nephrology.

[37]  Jürgen Schmidhuber,et al.  A reinforcement learning approach for individualizing erythropoietin dosages in hemodialysis patients , 2009, Expert Syst. Appl..

[38]  Shankar Prinja,et al.  Cost of hemodialysis in a public sector tertiary hospital of India , 2018, Clinical kidney journal.

[39]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[40]  M. Burnier,et al.  Would artificial neural networks implemented in clinical wards help nephrologists in predicting epoetin responsiveness? , 2006, BMC nephrology.