Contrastive Learning of Temporal Distinctiveness for Survival Analysis in Electronic Health Records

Survival analysis plays a crucial role in many healthcare decisions, where the risk prediction for the events of interest can support an informative outlook for a patient's medical journey. Given the existence of data censoring, an effective way of survival analysis is to enforce the pairwise temporal concordance between censored and observed data, aiming to utilize the time interval before censoring as partially observed time-to-event labels for supervised learning. Although existing studies mostly employed ranking methods to pursue an ordering objective, contrastive methods which learn a discriminative embedding by having data contrast against each other, have not been explored thoroughly for survival analysis. Therefore, in this paper, we propose a novel Ontology-aware Temporality-based Contrastive Survival (OTCSurv) analysis framework that utilizes survival durations from both censored and observed data to define temporal distinctiveness and construct negative sample pairs with adjustable hardness for contrastive learning. Specifically, we first use an ontological encoder and a sequential self-attention encoder to represent the longitudinal EHR data with rich contexts. Second, we design a temporal contrastive loss to capture varying survival durations in a supervised setting through a hardness-aware negative sampling mechanism. Last, we incorporate the contrastive task into the time-to-event predictive task with multiple loss components. We conduct extensive experiments using a large EHR dataset to forecast the risk of hospitalized patients who are in danger of developing acute kidney injury (AKI), a critical and urgent medical condition. The effectiveness and explainability of the proposed model are validated through comprehensive quantitative and qualitative studies.

[1]  D. Sow,et al.  Ontology-Aware Prescription Recommendation in Treatment Pathways using Multi-Evidence Healthcare Data , 2023, ACM Transactions on Information Systems.

[2]  Zhengxing Huang,et al.  Deep-CSA: Deep Contrastive Learning for Dynamic Survival Analysis With Competing Risks , 2022, IEEE Journal of Biomedical and Health Informatics.

[3]  F. Duah,et al.  Acute Kidney Injury in Patients with Liver Cirrhosis: Prevalence, Predictors, and In-Hospital Mortality at a District Hospital in Ghana , 2022, BioMed research international.

[4]  Jimeng Sun,et al.  SurvTRACE: transformers for survival analysis with competing events , 2021, ACM International Conference on Bioinformatics, Computational Biology and Biomedicine.

[5]  Qi Tian,et al.  Semi-Supervised Contrastive Learning With Similarity Co-Calibration , 2021, IEEE Transactions on Multimedia.

[6]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[7]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[8]  Changhee Lee,et al.  Dynamic-DeepHit: A Deep Learning Approach for Dynamic Survival Analysis With Competing Risks Based on Longitudinal Data , 2020, IEEE Transactions on Biomedical Engineering.

[9]  Benjamin C. M. Fung,et al.  Medical Concept Embedding with Multiple Ontological Representations , 2019, IJCAI.

[10]  A. Leelahavanichkul,et al.  Acute kidney injury spectrum in patients with chronic liver disease: Where do we stand? , 2019, World journal of gastroenterology.

[11]  Ida Scheel,et al.  Time-to-Event Prediction with Neural Networks and Cox Regression , 2019, J. Mach. Learn. Res..

[12]  Y. Shacham Acute kidney injury in acute myocardial infarction - A never-ending story? , 2019, International journal of cardiology.

[13]  Fenglong Ma,et al.  KAME: Knowledge-based Attention Model for Diagnosis Prediction in Healthcare , 2018, CIKM.

[14]  Mihaela van der Schaar,et al.  RNN-SURV: A Deep Recurrent Model for Survival Analysis , 2018, ICANN.

[15]  Lei Zheng,et al.  Deep Recurrent Survival Analysis , 2018, AAAI.

[16]  Balasubramanian Narasimhan,et al.  A scalable discrete-time survival model for neural networks , 2018, PeerJ.

[17]  Changhee Lee,et al.  DeepHit: A Deep Learning Approach to Survival Analysis With Competing Risks , 2018, AAAI.

[18]  Uri Shaham,et al.  DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network , 2016, BMC Medical Research Methodology.

[19]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[20]  Stephane Fotso,et al.  Deep Neural Networks for Survival Analysis Based on a Multi-Task Framework , 2018, ArXiv.

[21]  Le Song,et al.  GRAM: Graph-based Attention Model for Healthcare Representation Learning , 2016, KDD.

[22]  Yee Whye Teh,et al.  Gaussian Processes for Survival Analysis , 2016, NIPS.

[23]  Xiao-lu Ma,et al.  Risk factors of acute kidney injury in patients with acute myocardial infarction , 2016 .

[24]  Adler J. Perotte,et al.  Deep Survival Analysis , 2016, MLHC.

[25]  David M. Blei,et al.  Deep Exponential Families , 2014, AISTATS.

[26]  David Madigan,et al.  Large‐scale parametric survival analysis , 2013, Statistics in medicine.

[27]  Russell Greiner,et al.  Learning Patient-Specific Cancer Survival Distributions as a Sequence of Dependent Regressors , 2011, NIPS.

[28]  Hemant Ishwaran,et al.  Random Survival Forests , 2008, Wiley StatsRef: Statistics Reference Online.

[29]  H. Krumholz,et al.  Long-term prognosis of acute kidney injury after acute myocardial infarction. , 2008, Archives of internal medicine.

[30]  Elia Biganzoli,et al.  A time‐dependent discrimination index for survival data , 2005, Statistics in medicine.

[31]  Robert Gray,et al.  A Proportional Hazards Model for the Subdistribution of a Competing Risk , 1999 .

[32]  J. Robinette,et al.  Effect of hemorrhagic reduction in blood pressure on recovery from acute renal failure. , 1987, Kidney international.

[33]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[34]  Egill A. Fridgeirsson,et al.  Transformer-Based Deep Survival Analysis , 2021, SPACA.

[35]  K. Yip,et al.  A new mouse model of hemorrhagic shock-induced acute kidney injury. , 2017, American journal of physiology. Renal physiology.

[36]  A. Dreher Modeling Survival Data Extending The Cox Model , 2016 .

[37]  D.,et al.  Regression Models and Life-Tables , 2022 .