Automated Survival Prediction in Metastatic Cancer Patients Using High-Dimensional Electronic Medical Record Data.

Background Oncologists use patients' life expectancy to guide decisions and may benefit from a tool that accurately predicts prognosis. Existing prognostic models generally use only a few predictor variables. We used an electronic medical record dataset to train a prognostic model for patients with metastatic cancer. Methods The model was trained and tested using 12 588 patients treated for metastatic cancer in the Stanford Health Care system from 2008 to 2017. Data sources included provider note text, labs, vital signs, procedures, medication orders, and diagnosis codes. Patients were divided randomly into a training set used to fit the model coefficients and a test set used to evaluate model performance (80%/20% split). A regularized Cox model with 4126 predictor variables was used. A landmarking approach was used due to the multiple observations per patient, with t0 set to the time of metastatic cancer diagnosis. Performance was also evaluated using 399 palliative radiation courses in test set patients. Results The C-index for overall survival was 0.786 in the test set (averaged across landmark times). For palliative radiation courses, the C-index was 0.745 (95% confidence interval [CI] = 0.715 to 0.775) compared with 0.635 (95% CI = 0.601 to 0.669) for a published model using performance status, primary tumor site, and treated site (two-sided P < .001). Our model's predictions were well-calibrated. Conclusions The model showed high predictive performance, which will need to be validated using external data. Because it is fully automated, the model can be used to examine providers' practice patterns and could be deployed in a decision support tool to help improve quality of care.

[1]  Balasubramanian Narasimhan,et al.  A scalable discrete-time survival model for neural networks , 2018, PeerJ.

[2]  L. Ungar,et al.  Inclusion of Unstructured Clinical Text Improves Early Prediction of Death or Prolonged ICU Stay* , 2018, Critical care medicine.

[3]  Peter Szolovits,et al.  What’s in a Note? Unpacking Predictive Value in Clinical Note Representations , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[4]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[5]  Daniel L. Rubin,et al.  Probabilistic Prognostic Estimates of Survival in Metastatic Cancer Patients (PPES-Met) Utilizing Free-Text Clinical Narratives , 2018, Scientific Reports.

[6]  Balasubramanian Narasimhan,et al.  A Simple Discrete-Time Survival Model for Neural Networks , 2018, ArXiv.

[7]  Albee Y. Ling,et al.  A Clinical Score for Predicting Atrial Fibrillation in Patients with Cryptogenic Stroke or Transient Ischemic Attack , 2017, Cardiology.

[8]  Svetha Venkatesh,et al.  $\mathtt {Deepr}$: A Convolutional Net for Medical Records , 2016, IEEE Journal of Biomedical and Health Informatics.

[9]  Denis Talbot,et al.  30-day mortality after systemic anticancer treatment for breast and lung cancer in England: a population-based, observational study , 2016, The Lancet. Oncology.

[10]  Angela Mariotto,et al.  Sensitivity of Medicare Claims to Identify Cancer Recurrence in Elderly Colorectal and Breast Cancer Patients , 2016, Medical care.

[11]  E. Emanuel,et al.  Comparison of Site of Death, Health Care Utilization, and Hospital Expenditures for Patients Dying With Cancer in 7 Developed Countries. , 2016, JAMA.

[12]  Robert S. Miller,et al.  CancerLinQ Update. , 2016, Journal of oncology practice.

[13]  E. Elkin,et al.  Risk Adjusting Survival Outcomes in Hospitals That Treat Patients With Cancer Without Information on Cancer Stage. , 2015, JAMA oncology.

[14]  Marzyeh Ghassemi,et al.  Short-term Mortality Prediction for Elderly Patients Using Medicare Claims Data , 2015, International journal of machine learning and computing.

[15]  Andy Obermeyer,et al.  A Need for More, Better, and Earlier Conversations With Cancer Patients About Goals of Care , 2015 .

[16]  C. Marijnen,et al.  An easy tool to predict survival in patients receiving radiation therapy for painful bone metastases. , 2014, International journal of radiation oncology, biology, physics.

[17]  R. Jang,et al.  Simple prognostic model for patients with advanced cancer based on performance status. , 2014, Journal of oncology practice.

[18]  J. Temel,et al.  Predicting life expectancy in patients with metastatic cancer receiving palliative radiotherapy: The TEACHH model , 2014, Cancer.

[19]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[20]  K. Ramchandran,et al.  A predictive model to identify hospitalized cancer patients at risk for 30‐day mortality based on admission criteria via the electronic medical record , 2013, Cancer.

[21]  J. Temel,et al.  Predicting life expectancy in patients with advanced incurable cancer: a review. , 2013, The journal of supportive oncology.

[22]  C. Hudis,et al.  ASCO's approach to a learning health care system in oncology. , 2013, Journal of oncology practice.

[23]  P. Royston,et al.  External validation of a Cox prognostic model: principles and methods , 2013, BMC Medical Research Methodology.

[24]  M. Maltoni,et al.  Prospective comparison of prognostic scores in palliative care cancer populations. , 2012, The oncologist.

[25]  P. Stone,et al.  Development of Prognosis in Palliative care Study (PiPS) predictor models to improve prognostication in advanced cancer: prospective cohort study , 2011, BMJ : British Medical Journal.

[26]  Trevor Hastie,et al.  Regularization Paths for Cox's Proportional Hazards Model via Coordinate Descent. , 2011, Journal of statistical software.

[27]  Jeff Myers,et al.  Interconversion of three measures of performance status: an empirical analysis. , 2010, European journal of cancer.

[28]  John B Carlin,et al.  American Journal of Epidemiology Practice of Epidemiology Strategies for Multiple Imputation in Longitudinal Studies , 2022 .

[29]  Sunita Ghosh,et al.  International patterns of practice in palliative radiotherapy for painful bone metastases: evidence-based practice? , 2008, International journal of radiation oncology, biology, physics.

[30]  I. Tannock,et al.  Predictive model for survival in patients with advanced cancer. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[31]  R. Ivker,et al.  Can physicians accurately predict survival time in patients with metastatic cancer? Analysis of RTOG 97-14. , 2008, Journal of palliative medicine.

[32]  I. Higginson,et al.  Cancer Trajectories at the End of Life: is there an effect of age and gender? , 2008, BMC Cancer.

[33]  H. V. Houwelingen Dynamic Prediction by Landmarking in Event History Analysis , 2007 .

[34]  John H Suh,et al.  Randomized trial of short- versus long-course radiotherapy for palliation of painful bone metastases. , 2005, Journal of the National Cancer Institute.

[35]  T. Panzarella,et al.  Accuracy of survival prediction by palliative radiation oncologists. , 2005, International journal of radiation oncology, biology, physics.

[36]  C. Begg,et al.  Resurrecting treatment histories of dead patients: a study design that should be laid to rest. , 2004, JAMA.

[37]  C. Earle,et al.  Trends in the aggressiveness of cancer care near the end of life. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[38]  E. McCarthy,et al.  Dying with Cancer: Patients' Function, Symptoms, and Care Preferences as Death Approaches , 2000, Journal of the American Geriatrics Society.

[39]  E. DeLong,et al.  Discordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research , 1993, Annals of Internal Medicine.