Predicting ambulance offload delay using a hybrid decision tree model

Abstract Ambulance offload delay (AOD) is a growing health care concern in Canada. It refers to the delay in transferring an ambulance patient to a hospital emergency department (ED) due to ED congestion. It can negatively affect the ability of the ambulance service to respond to future calls and reduce the efficiency of the system when the delay is significant. Using integrated historical data from a partnering hospital and an Emergency Medical Services (EMS) provider, we developed a decision-support tool using a hybrid decision tree model to predict the severity of AOD occurring within 1–5 h in an EMS system. The primary objective of this study is to provide an AOD prediction model based on the current system status, hour of the day, and day of the week. With this information, decision-makers can be proactive with efforts to mitigate AOD. Various prediction models are developed with different focuses and forecast periods. This research demonstrates a novel hybrid decision tree method applied with administrative data in a health care setting. A naive Bayes classifier is first used to remove noisy training observations before decision tree induction. This hybrid decision tree algorithm was tested against the basic classification and regression tree (CART) algorithm, using classification accuracy, precision, sensitivity, and specificity analysis. The results indicate that the hybrid algorithm shows improvements in performance in the classification of the real-world problem. It is anticipated that the prediction model for AOD produced from this study will be directly transferable. It can be generalized to other EMS systems, where predicting AOD is important for efficient operations.

[1]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[2]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[3]  Mateo Restrepo,et al.  Erlang loss models for the static deployment of ambulances , 2009, Health care management science.

[4]  K. Sporer,et al.  Statewide Method of Measuring Ambulance Patient Offload Times , 2018, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[5]  Li Zhang,et al.  Hybrid decision tree and naïve Bayes classifiers for multi-class classification tasks , 2014, Expert Syst. Appl..

[6]  Xavier Llorà,et al.  Evolution of Decision Trees , 2001 .

[7]  Tapio Elomaa,et al.  An Analysis of Reduced Error Pruning , 2001, J. Artif. Intell. Res..

[8]  Donato Malerba,et al.  A Comparative Analysis of Methods for Pruning Decision Trees , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Sreerama K. Murthy,et al.  Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey , 1998, Data Mining and Knowledge Discovery.

[10]  E. Yano,et al.  Uniform prehospital data elements and definitions: a report from the uniform prehospital emergency medical services data conference. , 1995, Annals of emergency medicine.

[11]  Patricio Donoso,et al.  Assessing an ambulance service with queuing theory , 2008, Comput. Oper. Res..

[12]  Eman Almehdawe,et al.  Queueing Network Models of Ambulance Offload Delays , 2012 .

[13]  Qi-Ming He,et al.  Analysis and optimization of an ambulance offload delay and allocation problem , 2016 .

[14]  Mengyu Li,et al.  A review on ambulance offload delay literature , 2018, Health care management science.

[15]  M. Eckstein,et al.  The effect of emergency department crowding on paramedic ambulance availability. , 2004, Annals of Emergency Medicine.

[16]  Carla E. Brodley,et al.  Pruning Decision Trees with Misclassification Costs , 1998, ECML.

[17]  D. Carter,et al.  The ethics of ambulance ramping , 2017, Emergency medicine Australasia : EMA.

[18]  Michael G. Millin,et al.  Ambulance Diversion and Emergency Department Offload Delay: Resource Document for the National Association of EMS Physicians Position Statement , 2011, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[19]  Qi-Ming He,et al.  A Markovian queueing model for ambulance offload delays , 2013, Eur. J. Oper. Res..

[20]  S. Appavu alias Balamurugan,et al.  Effective solution for unhandled exception in decision tree induction algorithms , 2009, Expert Syst. Appl..

[21]  Yanli Wang,et al.  Developing and validating predictive decision tree models from mining chemical structural fingerprints and high–throughput screening data in PubChem , 2008, BMC Bioinformatics.

[22]  Reinaldo Morabito,et al.  Analysis of ambulance decentralization in an urban emergency medical service using the hypercube queueing model , 2007, Comput. Oper. Res..

[23]  Kyuseok Shim,et al.  Efficient algorithms for constructing decision trees with constraints , 2000, KDD '00.

[24]  J. Overton,et al.  Can emergency medical services use turnaround time as a proxy for measuring ambulance offload time? , 2014, The Journal of emergency medicine.

[25]  Jan L Jensen,et al.  Offload zones to mitigate emergency medical services (EMS) offload delay in the emergency department: a process map and hazard analysis. , 2015, CJEM.

[26]  Maya B. Mathur,et al.  Demographic and Clinical Predictors of Mortality from Highly Pathogenic Avian Influenza A (H5N1) Virus Infection: CART Analysis of International Cases , 2014, PloS one.

[27]  Won Chul Cha,et al.  Emergency Department Overcrowding and Ambulance Turnaround Time , 2015, PloS one.

[28]  Joseph YS Ting The potential adverse patient effects of ambulance ramping, a relatively new problem at the interface between prehospital and ED care , 2008, Journal of emergencies, trauma, and shock.

[29]  Paul E. Pepe,et al.  Facilitating EMS Turnaround Intervals at Hospitals in the Face of Receiving Facility Overcrowding , 2005, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[30]  Mohammad Majedi,et al.  A Queueing Model to Study Ambulance Offload Delays , 2008 .

[31]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[32]  Hesham Mohamed El-Deeb,et al.  Suite of decision tree-based classification algorithms on cancer gene expression data , 2011 .

[33]  Kemal Polat,et al.  A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems , 2009, Expert Syst. Appl..

[34]  E Siva Sankari,et al.  Predicting membrane protein types using various decision tree classifiers based on various modes of general PseAAC for imbalanced datasets. , 2017, Journal of theoretical biology.

[35]  Carlos Soares,et al.  A Comparison of Ranking Methods for Classification Algorithm Selection , 2000, ECML.

[36]  Sotiris B. Kotsiantis,et al.  Decision trees: a recent overview , 2011, Artificial Intelligence Review.

[37]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[38]  J. Crilly,et al.  The lived experiences of patients and ambulance ramping in a regional Australian emergency department: An interpretive phenomenology study. , 2015, Australasian emergency nursing journal : AENJ.

[39]  J. R. Quinlan Induction of decision trees , 2004, Machine Learning.

[40]  J. Ross Quinlan,et al.  Simplifying decision trees , 1987, Int. J. Hum. Comput. Stud..

[41]  Ethem Alpaydın,et al.  Combined 5 x 2 cv F Test for Comparing Supervised Classification Learning Algorithms , 1999, Neural Comput..

[42]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[43]  Philip J Day,et al.  Artificial neural networks and decision tree model analysis of liver cancer proteomes. , 2007, Biochemical and biophysical research communications.

[44]  S. Silvestri Impact of Emergency Department Bed Capacity on Emergency Medical Services Unit Off-load Time , 2006 .

[45]  P. Scuffham,et al.  Improving emergency department transfer for patients arriving by ambulance: A retrospective observational study , 2019, Emergency medicine Australasia : EMA.

[46]  Raphael M Barishansky,et al.  The effect of emergency department crowding on ambulance availability. , 2004, Annals of emergency medicine.

[47]  J. Crilly,et al.  The effects of ambulance ramping on Emergency Department length of stay and in-patient mortality , 2009 .

[48]  Wei-Chung Cheng,et al.  Gene selection for cancer identification: a decision tree model empowered by particle swarm optimization algorithm , 2014, BMC Bioinformatics.

[49]  Matt J. Aitkenhead,et al.  A co-evolving decision tree classification method , 2008, Expert Syst. Appl..

[50]  M. Wallis,et al.  Improved outcomes for emergency department patients whose ambulance off-stretcher time is not delayed , 2015, Emergency medicine Australasia : EMA.

[51]  B. Chandra,et al.  Fuzzifying Gini Index based decision trees , 2009, Expert Syst. Appl..

[52]  Chunfu Shao,et al.  Cluster-Based Logistic Regression Model for Holiday Travel Mode Choice , 2016 .

[53]  S. Silvestri Evaluation of Patients in Delayed Emergency Medical Services Unit Off-load Status , 2006 .

[54]  Chih-Hao Chen,et al.  Applying decision tree and neural network to increase quality of dermatologic diagnosis , 2009, Expert Syst. Appl..

[55]  F. Kay-Lambkin,et al.  Predictors of suicidal ideation in older people: a decision tree analysis. , 2014, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[56]  Arno De Caigny,et al.  A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees , 2018, Eur. J. Oper. Res..

[57]  Barak Aviad,et al.  Classification by clustering decision tree-like classifier based on adjusted clusters , 2011 .