The Challenge of Mass Casualty Incident Response Simulation Exercise Design and Creation: A Modified Delphi Study

Abstract Background: A Mass Casualty Incident response (MCI) full scale exercise (FSEx) assures MCI first responder (FR) competencies. Simulation and serious gaming platforms (Simulation) have been considered to achieve and maintain FR competencies. The translational science (TS) T0 question was asked: how can FRs achieve similar MCI competencies as a FSEx through the use of MCI simulation exercises? Methods: T1 stage (Scoping Review): PRISMA-ScR was conducted to develop statements for the T2 stage modified Delphi (mD) study. 1320 reference titles and abstracts were reviewed with 215 full articles progressing for full review leading to 97 undergoing data extraction. T2 stage (mD study): Selected experts were presented with 27 statements derived from T1 data with instruction to rank each statement on a 7-point linear numeric scale, where 1 = disagree and 7 = agree. Consensus amongst experts was defined as a standard deviation ≤ 1.0. Results: After 3 mD rounds, 19 statements attained consensus and 8 did not attain consensus. Conclusions: MCI simulation exercises can be developed to achieve similar competencies as FSEx by incorporating the 19 statements that attained consensus through the TS stages of a scoping review (T1) and mD study (T2), and continuing to T3 implementation, and then T4 evaluation stages.

[1]  M. Bergren,et al.  Improving rural disaster response preparedness. , 2021, Public health nursing.

[2]  J. R. Tucker,et al.  Medical student coping and performance in simulated disasters , 2021, Anxiety, stress, and coping.

[3]  Denghui Ma,et al.  Does theme game-based teaching promote better learning about disaster nursing than scenario simulation: A randomized controlled trial. , 2021, Nurse education today.

[4]  Shital C. Shah,et al.  Mass-Casualty Training Exercise Using High-Fidelity Computerized Simulators and Involving Time and Resource Limitation , 2021, Prehospital and Disaster Medicine.

[5]  N. Foo,et al.  A 36-Hour Unplugged Full-Scale Exercise: Closing the Gaps in Interagency Collaboration between the Disaster Medical Assistance Team and Urban Search and Rescue Team in Disaster Preparedness in Taiwan , 2021, Emergency medicine international.

[6]  G. Posner,et al.  Integration of In Situ Simulation Into an Emergency Department Code Orange Exercise in a Tertiary Care Trauma Referral Center , 2021, AEM education and training.

[7]  A. Tavakoli,et al.  Students Experience Mass Casualty Nursing From the Patient Perspective in a Simulated Mass Casualty Exercise , 2021, Nursing education perspectives.

[8]  H. Sule,et al.  Disaster Preparedness Training for Emergency Medicine Residents Using a Tabletop Exercise , 2021, MedEdPORTAL : the journal of teaching and learning resources.

[9]  Chu Hyun Kim,et al.  The effects of a community-based disaster drill of simulating Disaster Medical Assistance Team (DMAT) on the knowledge and attitudes. , 2021, Ulusal travma ve acil cerrahi dergisi = Turkish journal of trauma & emergency surgery : TJTES.

[10]  Thomas Moser,et al.  Virtual Reality Based Mass Disaster Triage Training for Emergency Medical Services , 2021, 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[11]  L. Clayton,et al.  Disaster Day: A Simulation-Based Disaster Medicine Curriculum for Novice Learners , 2021, Journal of medical education and curricular development.

[12]  M. Greco,et al.  Mass Casualty Incident (MCI) training in a metropolitan university hospital: short-term experience with MAss Casualty SIMulation system MACSIM® , 2020, European Journal of Trauma and Emergency Surgery.

[13]  G. Ricevuti,et al.  Preparing for the Maximum Emergency with a Simulation: A Table-Top Test to Evaluate Bed Surge Capacity and Staff Compliance with Training , 2020, Open access emergency medicine : OAEM.

[14]  Ethan N Hartman,et al.  Sort, Assess, Life-Saving Intervention, Triage With Drone Assistance in Mass Casualty Simulation: Analysis of Educational Efficacy , 2020, Cureus.

[15]  Tavis Dickerson-Young,et al.  Pediatric Emergency Medicine Disaster Simulation Curriculum: The 5-Minute Trauma Assessment for Pediatric Residents (TRAP-5) , 2020, MedEdPORTAL : the journal of teaching and learning resources.

[16]  C. Winstead-Derlega,et al.  360 virtual reality pediatric mass casualty incident: A cross sectional observational study of triage and out‐of‐hospital intervention accuracy at a national conference , 2020, Journal of the American College of Emergency Physicians open.

[17]  E. Carlström,et al.  Alternative Leadership in Flexible Surge Capacity—The Perceived Impact of Tabletop Simulation Exercises on Thai Emergency Physicians Capability to Manage a Major Incident , 2020, Sustainability.

[18]  B. Friemert,et al.  Evaluation of the Terror and Disaster Surgical Care course , 2020, European Journal of Trauma and Emergency Surgery.

[19]  T. Paffrath,et al.  Terror and disaster surgical care: training experienced trauma surgeons in decision making for a MASCAL situation with a tabletop simulation game , 2020, European Journal of Trauma and Emergency Surgery.

[20]  L. Ragazzoni,et al.  A T2 Translational Science Modified Delphi Study: Spinal Motion Restriction in a Resource-Scarce Environment , 2020, Prehospital and Disaster Medicine.

[21]  Luke S Hopper,et al.  Virtual Reality Triage Training Can Provide Comparable Simulation Efficacy for Paramedicine Students Compared to Live Simulation-Based Scenarios , 2020, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[22]  P. Brindley,et al.  Fidelity in surgical simulation: further lessons from the S.T.A.R.T.T. course , 2020, Canadian journal of surgery. Journal canadien de chirurgie.

[23]  F. Petrini,et al.  An Island-Wide Disaster Drill to Train the Next Generation of Anesthesiologists: The SIAARTI Academy Experience , 2020, Disaster Medicine and Public Health Preparedness.

[24]  V. Goodwin,et al.  Scoping reviews. , 2019, Physiotherapy.

[25]  Ogcheol Lee,et al.  Effects of a simulation-based education program for nursing students responding to mass casualty incidents: A pre-post intervention study. , 2019, Nurse education today.

[26]  Barbara M. Walsh,et al.  Cost-effectiveness of a video game versus live simulation for disaster training , 2019, BMJ Simulation & Technology Enhanced Learning.

[27]  R. Falcone,et al.  Operation continued care: A large mass-casualty, full-scale exercise as a test of regional preparedness. , 2019, Surgery.

[28]  Petra Saskia Bayerl,et al.  Validating Virtual Reality as an Effective Training Medium in the Security Domain , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[29]  Homayoun Valafar,et al.  Designing and executing a functional exercise to test a novel informatics tool for mass casualty triage , 2019, J. Am. Medical Informatics Assoc..

[30]  Vangelis Metsis,et al.  A virtual and augmented reality platform for the training of first responders of the ambulance bus , 2019, PETRA.

[31]  D. Schonfeld,et al.  Extending the Reach of Pediatric Emergency Preparedness: A Virtual Tabletop Exercise Targeting Children’s Needs , 2019, Public health reports.

[32]  S. Bentley,et al.  A Simulated Mass Casualty Incident Triage Exercise: SimWars , 2019, MedEdPORTAL : the journal of teaching and learning resources.

[33]  M. Auerbach,et al.  A tabletop school bus rollover: Connecticut-wide drills to build pediatric disaster preparedness and promote a novel hospital disaster readiness checklist. , 2019, American journal of disaster medicine.

[34]  Allison J. Ames,et al.  Ethical Reasoning Debriefing in Disaster Simulations , 2019, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[35]  Á. J. García-Collado,et al.  Comparative study of a simulated incident with multiple victims and immersive virtual reality. , 2018, Nurse education today.

[36]  Mikhail Fominykh,et al.  Use of a Collaborative Virtual Reality Simulation for Multi-Professional Training in Emergency Management Communications , 2018, 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[37]  Zachary Munn,et al.  Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach , 2018, BMC Medical Research Methodology.

[38]  Monica L. Tenhunen,et al.  Planning and Implementing Disaster Drills for Undergraduate Nursing Students. , 2018, Nursing education perspectives.

[39]  Sharon L. Farra,et al.  Effects of Virtual Reality Simulation on Worker Emergency Evacuation of Neonates , 2018, Disaster Medicine and Public Health Preparedness.

[40]  J. McGowan,et al.  PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation , 2018, Annals of Internal Medicine.

[41]  Michael Herczeg,et al.  Human-Centered Design of a Virtual Reality Training Simulation for Mass Casualty Incidents , 2018, 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[42]  Barbara M. Walsh,et al.  Correlation Between Paramedic Disaster Triage Accuracy in Screen-Based Simulations and Immersive Simulations , 2018, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[43]  Alan Liu,et al.  The Wide Area Virtual Environment: A New Paradigm for Medical Team Training , 2018, HCI.

[44]  P. Arcos González,et al.  Analysis of performance and stress caused by a simulation of a mass casualty incident. , 2018, Nurse education today.

[45]  Deborah A. Saber,et al.  An Interprofessional Approach to Continuing Education With Mass Casualty Simulation: Planning and Execution. , 2017, Journal of continuing education in nursing.

[46]  Nisreen H Maghraby,et al.  A hospital mass casualty exercise using city buses and a tent as a hybrid system for patient decontamination. , 2017, American journal of disaster medicine.

[47]  Barbara M. Walsh,et al.  60 seconds to survival: A pilot study of a disaster triage video game for prehospital providers. , 2017, American journal of disaster medicine.

[48]  Barbara M. Walsh,et al.  Pediatric Disaster Triage: Multiple Simulation Curriculum Improves Prehospital Care Providers' Assessment Skills , 2017, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[49]  Deborah A. Saber,et al.  Interprofessional Mass Casualty Incident Simulation Design Protocol to Prepare Prelicensure Nursing Students to Respond to a Disaster , 2017, Nurse educator.

[50]  Heidi Wheeler,et al.  Utilization of Functional Exercises to Build Regional Emergency Preparedness among Rural Health Organizations in the US , 2017, Prehospital and Disaster Medicine.

[51]  Sultan A. Alharthi,et al.  Playing at Planning: Game Design Patterns from Disaster Response Practice , 2016, CHI PLAY.

[52]  Francesco Della Corte,et al.  Virtual Laboratory and Imaging: an online simulation tool to enhance hospital disaster preparedness training experience , 2016, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[53]  Y. Koido,et al.  Development of Mass-casualty Life Support-CBRNE (MCLS-CBRNE) in Japan , 2016, Prehospital and Disaster Medicine.

[54]  R. Burke,et al.  On Shaky Ground: Learner Response and Confidence After Tabletop Earthquake Simulation , 2016, Pediatric emergency care.

[55]  H. Stryhn,et al.  Comparison of the Sacco Triage Method Versus START Triage Using a Virtual Reality Scenario in Advance Care Paramedic Students. , 2016, CJEM.

[56]  Kimberly Schertzer,et al.  Disaster Medicine: A Multi-Modality Curriculum Designed and Implemented for Emergency Medicine Residents , 2016, Disaster Medicine and Public Health Preparedness.

[57]  C. Roberts,et al.  A large-scale mass casualty simulation to develop the non-technical skills medical students require for collaborative teamwork , 2016, BMC medical education.

[58]  Jeffrey M. Franc,et al.  First Responder Accuracy Using SALT during Mass-casualty Incident Simulation , 2016, Prehospital and Disaster Medicine.

[59]  N. Connell,et al.  A Course on Terror Medicine: Content and Evaluations , 2016, Prehospital and Disaster Medicine.

[60]  M. Carman,et al.  Disaster Preparedness in the Emergency Department Using In Situ Simulation , 2016, Advanced emergency nursing journal.

[61]  T. Chang,et al.  Comparison of Computerized Patients versus Live Moulaged Actors for a Mass-casualty Drill , 2015, Prehospital and Disaster Medicine.

[62]  Davide Colombo,et al.  Disaster medicine through Google Glass. , 2015, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[63]  K. Dreifuerst Getting Started With Debriefing for Meaningful Learning , 2015 .

[64]  Davide Colombo,et al.  Virtual reality and live simulation: a comparison between two simulation tools for assessing mass casualty triage skills , 2015, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[65]  H. W. Nelson,et al.  Pediatric mass-casualty education: experiential learning through university-sponsored disaster simulation. , 2014, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[66]  Ara Darzi,et al.  Virtual-world hospital simulation for real-world disaster response: Design and validation of a virtual reality simulator for mass casualty incident management , 2014, The journal of trauma and acute care surgery.

[67]  Jiaping Wu,et al.  The Role of Probability , 2014 .

[68]  E. Kochs,et al.  High-fidelity Human Patient Simulators Compared with Human Actors in an Unannounced Mass-Casualty Exercise , 2014, Prehospital and Disaster Medicine.

[69]  B. Arquilla,et al.  Waterworks, a Full-Scale Chemical Exposure Exercise: Interrogating Pediatric Critical Care Surge Capacity in an Inner-City Tertiary Care Medical Center , 2013, Prehospital and Disaster Medicine.

[70]  Heléne Nilsson,et al.  Simulation-assisted burn disaster planning. , 2013, Burns : journal of the International Society for Burn Injuries.

[71]  C. Noonan,et al.  Managing Multiple-Casualty Incidents: A Rural Medical Preparedness Training Assessment , 2013, Prehospital and Disaster Medicine.

[72]  Thomas C. Reeves,et al.  Value of a Ludic Simulation in Training First Responders to Manage Blast Incidents , 2013, Int. J. Gaming Comput. Mediat. Simulations.

[73]  R. Ramloll,et al.  vTrain: A Novel Curriculum for Patient Surge Training in a Multi-User Virtual Environment (MUVE) , 2013, Prehospital and Disaster Medicine.

[74]  F. Kagawa,et al.  Ready for the Storm: Education for Disaster Risk Reduction and Climate Change Adaptation and Mitigation1 , 2012 .

[75]  D. Klima,et al.  Full-scale regional exercises: Closing the gaps in disaster preparedness , 2012, The journal of trauma and acute care surgery.

[76]  B. Kessel,et al.  Assessment of hospital disaster plans for conventional mass casualty incidents following terrorist explosions using a live exercise based upon the real data of actual patients , 2012, European Journal of Trauma and Emergency Surgery.

[77]  J. Leow,et al.  Mass casualty incident training in a resource‐limited environment , 2012, The British journal of surgery.

[78]  Frederick M Burkle,et al.  The Evaluation of Research Methods during Disaster Exercises: Applicability for Improving Disaster Health Management , 2012, Prehospital and Disaster Medicine.

[79]  Lisa Kurland,et al.  Comparison of the SALT and Smart triage systems using a virtual reality simulator with paramedic students , 2011, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[80]  Davide Colombo,et al.  Evaluation of medical management during a mass casualty incident exercise: an objective assessment tool to enhance direct observation. , 2010, The Journal of emergency medicine.

[81]  W. L. Heinrichs,et al.  Training Healthcare Personnel for Mass-Casualty Incidents in a Virtual Emergency Department: VED II , 2010, Prehospital and Disaster Medicine.

[82]  James F. Knight,et al.  Serious gaming technology in major incident triage training: a pragmatic controlled trial. , 2010, Resuscitation.

[83]  P. Andreatta,et al.  Virtual reality triage training provides a viable solution for disaster-preparedness. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[84]  R. Strack,et al.  Promoting Community Preparedness: Lessons Learned From the Implementation of a Chemical Disaster Tabletop Exercise , 2010, Health promotion practice.

[85]  Heléne Nilsson,et al.  Evaluation of Medical Command and Control Using Performance Indicators in a Full-Scale, Major Aircraft Accident Exercise , 2010, Prehospital and Disaster Medicine.

[86]  Phillip L Coule,et al.  Use of SALT Triage in a Simulated Mass-Casualty Incident , 2010, Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors.

[87]  S. Briggs Regional interoperability: making systems connect in complex disasters. , 2009, The Journal of trauma.

[88]  Bonnie Arquilla,et al.  Simulation in a disaster drill: comparison of high-fidelity simulators versus trained actors. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[89]  Klaus-Peter Beier,et al.  Using immersive simulation for training first responders for mass casualty incidents. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[90]  Elsa Lee,et al.  Homeland Security Exercise and Evaluation Program , 2008 .

[91]  Heléne Nilsson,et al.  Management of resources at major incidents and disasters in relation to patient outcome: a pilot study of an educational model , 2008, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[92]  Joyce Donnellan,et al.  Development of an “All-Hazards” Hospital Disaster Preparedness Training Course Utilizing Multi-Modality Teaching , 2008, Prehospital and Disaster Medicine.

[93]  J. Edwards,et al.  Developing Disaster Preparedness Competence: An Experiential Learning Exercise for Multiprofessional Education , 2008, Teaching and learning in medicine.

[94]  M. Nobre,et al.  The PICO strategy for the research question construction and evidence search. , 2007, Revista latino-americana de enfermagem.

[95]  Y. Bar-dayan,et al.  Who Should Worry for the “Worried Well”? Analysis of Mild Casualties Center Drills in Non-Conventional Scenarios , 2006, Prehospital and Disaster Medicine.

[96]  Kristi L Koenig,et al.  Surge capacity for healthcare systems: a conceptual framework. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[97]  J. Stella,et al.  What a Disaster?! Assessing Utility of Simulated Disaster Exercise and Educational Process for Improving Hospital Preparedness , 2006, Prehospital and Disaster Medicine.

[98]  T. Terndrup,et al.  Integrated Decision-Making in Response to Weapons of Mass Destruction Incidents: Development and Initial Evaluation of a Course for Healthcare Professionals , 2006, Prehospital and Disaster Medicine.

[99]  G. Bandiera,et al.  A multiphase disaster training exercise for emergency medicine residents: opportunity knocks. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[100]  Edbert B Hsu,et al.  The Incident Command System in Disasters: Evaluation Methods for a Hospital-based Exercise , 2005, Prehospital and Disaster Medicine.

[101]  R. Lowy,et al.  A multidisciplinary approach to teach responses to weapons of mass destruction and terrorism using combined simulation modalities. , 2004, Journal of clinical anesthesia.

[102]  C. Ng,et al.  Designation of a new training model of a local disaster medical system with tabletop exercises. , 2003, Chang Gung medical journal.

[103]  Gary B Green,et al.  Generic evaluation methods for disaster drills in developing countries. , 2003, Annals of emergency medicine.

[104]  J. Shemer,et al.  The Efficacy of Integrating “Smart Simulated Casualties” in Hospital Disaster Drills , 1997, Prehospital and Disaster Medicine.

[105]  E. Fox,et al.  Criteria for Preparation and Evaluation of Radiological Emergency Response Plans and Preparedness in Support of Nuclear Power Plants: Criteria for Emergency Planning in an Early Site Permit , 1996 .

[106]  N. Caroline Disaster Response: Principles of Preparation and Coordination , 1992 .

[107]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[108]  Michael Herczeg,et al.  Immersion and Presence in Virtual Reality Training for Mass Casualty Incidents , 2018, ISCRAM.

[109]  Sultan A. Alharthi,et al.  Practical Insights into the Design of Future Disaster Response Training Simulations , 2018, ISCRAM.

[110]  Ehren B. Ngo,et al.  Healthcare students interprofessional critical event/disaster response course. , 2017, American journal of disaster medicine.

[111]  L. Fletcher,et al.  Designing a disaster. , 2015, Journal of trauma nursing : the official journal of the Society of Trauma Nurses.

[112]  J. Maher,et al.  An evaluation of learner perception of competency and satisfaction with three models of an interdisciplinary surge capacity course. , 2012, Journal of allied health.

[113]  Elizabeth A. Turner,et al.  Making acute hospital exercises more realistic without impacting on healthcare delivery. , 2012, Journal of business continuity & emergency planning.

[114]  Leslie Holmes,et al.  Use of an emergency preparedness disaster simulation with undergraduate nursing students. , 2012, Public health nursing.

[115]  Sergei N. Kurenov,et al.  Game-Based Mass Casualty Burn Training , 2009, MMVR.

[116]  C. V. Anderson,et al.  The Federal Emergency Management Agency (FEMA) , 2002 .