A simulation and optimization based method for calibrating agent-based emergency department models under data scarcity

A method to calibrate an emergency department model with incomplete data.Simulation-based optimization for model parameter calibration.An accurate emergency department simulator. To tackle the problem of efficiently managing increasingly complex systems, simulation models have been widely used. This is because simulation is safer, less expensive, and faster than field implementation and experimenting. To achieve high fidelity and credibility in conducting prediction and exploration of the actual system with simulation models, a rigorous calibration and validation procedure should firstly be applied. However, one of the key issues in calibration is the acquisition of valid source information from the target system. The aim of this study is to develop a systematic method to automatically calibrate a general emergency department model with incomplete data. The simulation-based optimization was used to search for the best value of model parameters. Then we present a case study to particularly demonstrate the way to calibrate an agent-based model of an emergency department with real data scarcity. The case study indicates that the proposed method appears to be capable of properly calibrating and validating the simulation model with incomplete data.

[1]  M. Bullard,et al.  Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) adult guidelines. , 2008, CJEM.

[2]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[3]  David McD Taylor,et al.  Review article: Leaving the emergency department without being seen , 2008, Emergency medicine Australasia : EMA.

[4]  Peter M. A. Sloot,et al.  Information processing as a paradigm to model and simulate complex systems , 2012, J. Comput. Sci..

[5]  Shari J. Welch,et al.  Emergency department operational metrics, measures and definitions: results of the Second Performance Measures and Benchmarking Summit. , 2011, Annals of emergency medicine.

[6]  Emilio Luque,et al.  Quantitative Evaluation of Decision Effects in the Management of Emergency Department Problems , 2015, ICCS.

[7]  Dominik Aronsky,et al.  Forecasting emergency department crowding: an external, multicenter evaluation. , 2009, Annals of emergency medicine.

[8]  Andrew Beck,et al.  Simulation: the practice of model development and use , 2008, J. Simulation.

[9]  Michele L Johnson,et al.  Patients who leave the emergency department without being seen. , 2009, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[10]  Tamara G. Kolda,et al.  Asynchronous Parallel Generating Set Search for Linearly Constrained Optimization , 2008, SIAM J. Sci. Comput..

[11]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[12]  Shari J. Welch,et al.  Emergency department performance measures and benchmarking summit. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[13]  Daniel Heard,et al.  Agent-Based Models and Microsimulation , 2015 .

[14]  Celso Leandro Palma,et al.  Simulation: The Practice of Model Development and Use , 2016 .

[15]  Laura Painton Swiler,et al.  Calibration, validation, and sensitivity analysis: What's what , 2006, Reliab. Eng. Syst. Saf..

[16]  Emilio Luque,et al.  Simulating the micro-level behavior of emergency department for macro-level features prediction , 2015, 2015 Winter Simulation Conference (WSC).

[17]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[18]  Gabor D Kelen,et al.  Patients who leave without being seen: their characteristics and history of emergency department use. , 2006, Annals of emergency medicine.

[19]  Michael Lees,et al.  Evolving agent-based models using self-adaptive complexification , 2015, J. Comput. Sci..

[20]  Marko A. Hofmann,et al.  On the Complexity of Parameter Calibration in Simulation Models , 2005 .

[21]  Tamara G. Kolda,et al.  Algorithm 856: APPSPACK 4.0: asynchronous parallel pattern search for derivative-free optimization , 2006, TOMS.

[22]  Frank Puppe,et al.  Approaches for resolving the dilemma between model structure refinement and parameter calibration in agent-based simulations , 2006, AAMAS '06.

[24]  C. Sutti Local and global optimization by parallel algorithms for MIMD systems , 1984, Ann. Oper. Res..

[25]  Ali Fuat Guneri,et al.  A comprehensive review of emergency department simulation applications for normal and disaster conditions , 2015, Comput. Ind. Eng..

[26]  Cynthia Rudin,et al.  Algorithms for interpretable machine learning , 2014, KDD.

[27]  Tamara G. Kolda,et al.  Revisiting Asynchronous Parallel Pattern Search for Nonlinear Optimization , 2005, SIAM J. Optim..

[28]  Frank Puppe,et al.  Techniques for Analysis and Calibration of Multi-agent Simulations , 2004, ESAW.

[29]  Wentong Cai,et al.  Differential evolution with sensitivity analysis and the Powell's method for crowd model calibration , 2015, J. Comput. Sci..

[30]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[31]  Aditi Saxena,et al.  The Emergency Department , 2010 .

[32]  Jon C. Helton,et al.  Sensitivity Analysis of Model Output: SAMO 2004 , 2006, Reliab. Eng. Syst. Saf..

[33]  I. Vajda,et al.  A new class of metric divergences on probability spaces and its applicability in statistics , 2003 .

[34]  Dominik Endres,et al.  A new metric for probability distributions , 2003, IEEE Transactions on Information Theory.

[35]  William J. Stewart,et al.  Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling , 2009 .

[36]  Michael Lees,et al.  Title Density-based evolutionary framework for crowd model calibration , 2018 .

[37]  Moreno Marzolla,et al.  Netlogo , 2019, Economics for a Fairer Society.

[38]  R. Sánchez Bermejo,et al.  El triaje en urgencias en los hospitales españoles , 2013 .

[39]  Emilio Luque,et al.  A Generalized Agent-Based Model to Simulate Emergency Departments , 2014 .