Unstructured Text in EMR Improves Prediction of Death after Surgery in Children

Text fields in electronic medical records (EMR) contain information on important factors that influence health outcomes, however, they are underutilized in clinical decision making due to their unstructured nature. We analyzed 6497 inpatient surgical cases with 719,308 free text notes from Le Bonheur Children’s Hospital EMR. We used a text mining approach on preoperative notes to obtain a text-based risk score to predict death within 30 days of surgery. In addition, we evaluated the performance of a hybrid model that included the text-based risk score along with structured data pertaining to clinical risk factors. The C-statistic of a logistic regression model with five-fold cross-validation significantly improved from 0.76 to 0.92 when text-based risk scores were included in addition to structured data. We conclude that preoperative free text notes in EMR include significant information that can predict adverse surgery outcomes.

[1]  Scott T. Weiss,et al.  Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system , 2006, BMC Medical Informatics Decis. Mak..

[2]  S. Sheppard,et al.  Postoperative Mortality in Children After 101,885 Anesthetics at a Tertiary Pediatric Hospital , 2011, Anesthesia and analgesia.

[3]  Oguz Akbilgic,et al.  Race, Preoperative Risk Factors, and Death After Surgery , 2018, Pediatrics.

[4]  M. Girolami,et al.  Analysis of free text in electronic health records for identification of cancer patient trajectories , 2017, Scientific Reports.

[5]  Babatunde O. Ogunnaike,et al.  ASA Relative Value Guide (RVG): A Defining Moment in Fair Pricing of Medical Services , 2004 .

[6]  L. Ungar,et al.  Inclusion of Unstructured Clinical Text Improves Early Prediction of Death or Prolonged ICU Stay* , 2018, Critical care medicine.

[7]  Sukhoon Lee,et al.  Extracting information from free-text electronic patient records to identify practice-based evidence of the performance of coronary stents , 2017, PloS one.

[8]  Michael W. Berry,et al.  Understanding search engines: mathematical modeling and text retrieval (software , 1999 .

[9]  R. Epstein,et al.  TEPAPA: a novel in silico feature learning pipeline for mining prognostic and associative factors from text-based electronic medical records , 2017, Scientific Reports.

[10]  Shankar Vembu,et al.  Using the Electronic Medical Record to Identify Patients at High Risk for Frequent Emergency Department Visits and High System Costs. , 2017, The American journal of medicine.

[11]  Richard J Bold,et al.  Pediatric surgical readmissions: Are they truly preventable? , 2017, Journal of pediatric surgery.

[12]  C. Ko,et al.  Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. , 2013, Journal of the American College of Surgeons.

[13]  Alex H. S. Harris,et al.  Path From Predictive Analytics to Improved Patient Outcomes: A Framework to Guide Use, Implementation, and Evaluation of Accurate Surgical Predictive Models. , 2017, Annals of surgery.

[14]  C. Ko,et al.  Variation in intraoperative and postoperative red blood cell transfusion in pediatric surgery , 2016, Transfusion.

[15]  Chengyi Zheng,et al.  Extracting data from electronic medical records: validation of a natural language processing program to assess prostate biopsy results , 2013, World Journal of Urology.

[16]  F REHBEIN,et al.  [Pediatric surgery]. , 1958, Monatsschrift fur Kinderheilkunde.

[17]  Suchi Saria,et al.  Consensus Statement on Electronic Health Predictive Analytics: A Guiding Framework to Address Challenges , 2016, EGEMS.

[18]  Tamekia Jones,et al.  Identifying children at risk of death within 30 days of surgery at an NSQIP pediatric hospital. , 2015, Surgery.

[19]  C. Ko,et al.  Development and Evaluation of the American College of Surgeons NSQIP Pediatric Surgical Risk Calculator. , 2016, Journal of the American College of Surgeons.

[20]  George Hripcsak,et al.  Automated encoding of clinical documents based on natural language processing. , 2004, Journal of the American Medical Informatics Association : JAMIA.

[21]  Carrie McAdam-Marx,et al.  Application of electronic medical record data for health outcomes research: a review of recent literature , 2013, Expert review of pharmacoeconomics & outcomes research.

[22]  E. Ray Dorsey,et al.  The anatomy of health care in the United States. , 2013, JAMA.

[23]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[24]  Sunghwan Sohn,et al.  Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications , 2010, J. Am. Medical Informatics Assoc..

[25]  David W Bates,et al.  Integrating Predictive Analytics Into High-Value Care: The Dawn of Precision Delivery. , 2016, JAMA.

[26]  Donia Scott,et al.  Extracting information from the text of electronic medical records to improve case detection: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[27]  K. Oldham,et al.  Optimal resources for children's surgical care. , 2014, Journal of pediatric surgery.

[28]  Steven H. Brown,et al.  Automated identification of postoperative complications within an electronic medical record using natural language processing. , 2011, JAMA.

[29]  Robert L Davis,et al.  A novel risk classification system for 30-day mortality in children undergoing surgery , 2018, PloS one.

[30]  Eric C. Cheon,et al.  Unplanned, Postoperative Intubation in Pediatric Surgical Patients: Development and Validation of a Multivariable Prediction Model , 2016, Anesthesiology.