An automated machine learning-based model predicts postoperative mortality using readily-extractable preoperative electronic health record data.

BACKGROUND Rapid, preoperative identification of patients with the highest risk for medical complications is necessary to ensure that limited infrastructure and human resources are directed towards those most likely to benefit. Existing risk scores either lack specificity at the patient level or utilise the American Society of Anesthesiologists (ASA) physical status classification, which requires a clinician to review the chart. METHODS We report on the use of machine learning algorithms, specifically random forests, to create a fully automated score that predicts postoperative in-hospital mortality based solely on structured data available at the time of surgery. Electronic health record data from 53 097 surgical patients (2.01% mortality rate) who underwent general anaesthesia between April 1, 2013 and December 10, 2018 in a large US academic medical centre were used to extract 58 preoperative features. RESULTS Using a random forest classifier we found that automatically obtained preoperative features (area under the curve [AUC] of 0.932, 95% confidence interval [CI] 0.910-0.951) outperforms Preoperative Score to Predict Postoperative Mortality (POSPOM) scores (AUC of 0.660, 95% CI 0.598-0.722), Charlson comorbidity scores (AUC of 0.742, 95% CI 0.658-0.812), and ASA physical status (AUC of 0.866, 95% CI 0.829-0.897). Including the ASA physical status with the preoperative features achieves an AUC of 0.936 (95% CI 0.917-0.955). CONCLUSIONS This automated score outperforms the ASA physical status score, the Charlson comorbidity score, and the POSPOM score for predicting in-hospital mortality. Additionally, we integrate this score with a previously published postoperative score to demonstrate the extent to which patient risk changes during the perioperative period.

[1]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[2]  Amine Chikh,et al.  Machine Learning Tool for Automatic ASA Detection , 2013, Modeling Approaches and Algorithms for Advanced Computer Applications.

[3]  Armin Schubert,et al.  Broadly Applicable Risk Stratification System for Predicting Duration of Hospitalization and Mortality , 2010, Anesthesiology.

[4]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[5]  U. Wolters,et al.  ASA classification and perioperative variables as predictors of postoperative outcome. , 1996, British journal of anaesthesia.

[6]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[7]  Paul Landais,et al.  Preoperative Score to Predict Postoperative Mortality (POSPOM): Derivation and Validation , 2016, Anesthesiology.

[8]  J. Gold,et al.  Validation of a combined comorbidity index. , 1994, Journal of clinical epidemiology.

[9]  A. Mahajan,et al.  A Systematic Approach to Creation of a Perioperative Data Warehouse , 2016, Anesthesia and analgesia.

[10]  Robert Tibshirani,et al.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices , 2010, J. Mach. Learn. Res..

[11]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[12]  David A Harrison,et al.  Identification and characterisation of the high-risk surgical population in the United Kingdom , 2006, Critical care.

[13]  Fernando Nogueira,et al.  Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning , 2016, J. Mach. Learn. Res..

[14]  The Validity of Discharge Billing Codes Reflecting Severe Maternal Morbidity , 2016, Anesthesia and analgesia.

[15]  M. Daabiss,et al.  American Society of Anaesthesiologists physical status classification , 2011, Indian journal of anaesthesia.

[16]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[17]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[18]  J. Kvedar,et al.  Artificial intelligence powers digital medicine , 2018, npj Digital Medicine.

[19]  C. J. Vacanti,et al.  A Statistical Analysis of the Relationship of Physical Status to Postoperative Mortality in 68,388 Cases , 1970, Anesthesia and analgesia.

[20]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[21]  Pierre Baldi,et al.  Development and Validation of a Deep Neural Network Model for Prediction of Postoperative In-hospital Mortality , 2018, Anesthesiology.

[22]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[23]  N. Hackett,et al.  ASA class is a reliable independent predictor of medical complications and mortality following surgery. , 2015, International journal of surgery.

[24]  Daniel Fabbri,et al.  Data-Driven System for Perioperative Acuity Prediction , 2016, AMIA.

[25]  J. Efron,et al.  Early Surgical Intervention for Acute Ulcerative Colitis Is Associated with Improved Postoperative Outcomes , 2017, Journal of Gastrointestinal Surgery.

[26]  S. Yun,et al.  Early surgery versus conventional treatment for infective endocarditis. , 2012, The New England journal of medicine.

[27]  Bing Li,et al.  Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. , 2011, American journal of epidemiology.

[28]  C. Ko,et al.  Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. , 2013, Journal of the American College of Surgeons.

[29]  E. Mascha,et al.  Development and Validation of a Risk Quantification Index for 30-Day Postoperative Mortality and Morbidity in Noncardiac Surgical Patients , 2011, Anesthesiology.