Harnessing the power of simulation for assessment: Consensus recommendations for the use of simulation-based assessment in emergency medicine.

OBJECTIVES To address the increasing demand for the use of simulation for assessment, our objective was to review the literature pertaining to simulation-based assessment and develop a set of consensus-based expert-informed recommendations on the use of simulation-based assessment as presented at the 2019 Canadian Association of Emergency Physicians (CAEP) Academic Symposium on Education. METHODS A panel of Emergency Medicine (EM) physicians from across Canada, with leadership roles in simulation and/or assessment, was formed to develop the recommendations. An initial scoping literature review was conducted to extract principles of simulation-based assessment. These principles were refined via thematic analysis, and then used to derive a set of recommendations for the use of simulation-based assessment, organized by the Consensus Framework for Good Assessment. This was reviewed and revised via a national stakeholder survey, and then the recommendations were presented and revised at the consensus conference to generate a final set of recommendations on the use of simulation-based assessment in EM. CONCLUSION We developed a set of recommendations for simulation-based assessment, using consensus-based expert-informed methods, across the domains of validity, reproducibility, feasibility, educational and catalytic effects, acceptability, and programmatic assessment. While the precise role of simulation-based assessment will be a subject of continued debate, we propose that these recommendations be used to assist educators and program leaders as they incorporate simulation-based assessment into their programs of assessment.

[1]  Karen D. Könings,et al.  Barriers to the uptake and use of feedback in the context of summative assessment , 2015, Advances in health sciences education : theory and practice.

[2]  R. Hatala,et al.  A contemporary approach to validity arguments: a practical guide to Kane's framework , 2015, Medical education.

[3]  J. Frank,et al.  A call to action: The controversy of and rationale for competency-based medical education , 2017, Medical teacher.

[4]  Jenny W Rudolph,et al.  Establishing a Safe Container for Learning in Simulation: The Role of the Presimulation Briefing , 2014, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[5]  S. Ross,et al.  Evolving concepts of assessment in a competency-based world , 2017, Medical teacher.

[6]  J. Rich,et al.  Simulation versus real-world performance: a direct comparison of emergency medicine resident resuscitation entrustment scoring , 2019, Advances in Simulation.

[7]  S. Hamstra,et al.  Reconsidering fidelity in simulation-based training. , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[8]  A. Ziv,et al.  Simulation-based medical education: an ethical imperative. , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[9]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[10]  R. Duvivier,et al.  2018 Consensus framework for good assessment , 2018, Medical teacher.

[11]  J. Quinones,et al.  Developing technical expertise in emergency medicine--the role of simulation in procedural skill acquisition. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  F. Lateef Simulation-based learning: Just like the real thing , 2010, Journal of emergencies, trauma, and shock.

[13]  H. Arksey,et al.  Scoping studies: towards a methodological framework , 2005 .

[14]  C. Watling,et al.  Assessment, feedback and the alchemy of learning , 2018, Medical education.

[15]  R. Duvivier,et al.  Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 Conference , 2011, Medical teacher.

[16]  M. Auerbach,et al.  Simulation‐based Education to Ensure Provider Competency Within the Health Care System , 2018, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[17]  M. Hayter,et al.  Simulation-based assessment of anesthesiology residents’ competence: development and implementation of the Canadian National Anesthesiology Simulation Curriculum (CanNASC) , 2016, Canadian Journal of Anesthesia/Journal canadien d'anesthésie.

[18]  David A Cook,et al.  Technology-Enhanced Simulation to Assess Health Professionals: A Systematic Review of Validity Evidence, Research Methods, and Reporting Quality , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[19]  D. Howes,et al.  Simulation in Canadian postgraduate emergency medicine training - a national survey. , 2016, CJEM.

[20]  C. Walsh,et al.  Simulation curricular content in postgraduate emergency medicine: A multicentre Delphi study. , 2019, CJEM.

[21]  David A Cook,et al.  Linking Simulation-Based Educational Assessments and Patient-Related Outcomes: A Systematic Review and Meta-Analysis , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[22]  William C McGaghie,et al.  A critical review of simulation‐based mastery learning with translational outcomes , 2014, Medical education.