An Updated Review of Published Simulation Evaluation Instruments

Abstract Interest in simulation as a teaching and evaluation strategy in nursing education continues to grow. Mirroring this growth, we have seen a proliferation of instruments designed to evaluate simulation participant performance. This article describes two frameworks for categorizing simulation evaluation strategies and provides a review of recent simulation evaluation instruments. The review focuses on four instruments that have been used extensively in the literature, objective structured clinical examinations (OSCE's) including four OSCE instruments, and an extensive list of new instruments for simulation evaluation.

[1]  Carol Botwinski,et al.  Developing a successful nursing Objective Structured Clinical Examination. , 2010, The Journal of nursing education.

[2]  Robert Simon,et al.  Debriefing Assessment for Simulation in Healthcare: Development and Psychometric Properties , 2012, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[3]  M. Devita Society for Simulation in Healthcare Presidential Address, January 2009 , 2009, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[4]  William C McGaghie,et al.  Cost Savings From Reduced Catheter-Related Bloodstream Infection After Simulation-Based Education for Residents in a Medical Intensive Care Unit , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[5]  M. Clark Evaluating an Obstetric Trauma Scenario , 2006 .

[6]  M. Woo,et al.  Predictors of knowledge gains using simulation in the education of prelicensure nursing students. , 2012, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[7]  C. Cason,et al.  Learning CPR With the BLS AnytimeTM for Healthcare Providers Kit , 2011 .

[8]  Diana Coben,et al.  Numeracy for nursing, report of a pilot study to compare outcomes of two practical simulation tools--an online medication dosage assessment and practical assessment in the style of objective structured clinical examination. , 2010, Nurse education today.

[9]  W. Abdul-Hamid,et al.  The objective structured clinical examination (OSCE) , 2004 .

[10]  L. Gantt Using the Clark Simulation Evaluation Rubric with Associate Degree and Baccalaureate Nursing Students , 2010, Nursing education perspectives.

[11]  N. Ryan-Wenger,et al.  History and Development of the Simulation Effectiveness Tool (SET) , 2012 .

[12]  Sok Ying Liaw,et al.  Assessment for simulation learning outcomes: a comparison of knowledge and self-reported confidence with observed clinical performance. , 2012, Nurse education today.

[13]  Caralise W. Hunt,et al.  The Effects of Simulated Clinical Experiences on Anxiety: Nursing Students' Perspectives , 2011 .

[14]  Julie A. Manz,et al.  Improving Consistency of Assessment of Student Performance during Simulated Experiences , 2013 .

[15]  J. Samosky,et al.  Critical thinking skills in nursing students: comparison of simulation-based performance with metrics. , 2010, Journal of advanced nursing.

[16]  K. Haller,et al.  Using Research in Practice , 1986, Western journal of nursing research.

[17]  Lynn Senette,et al.  Passing the Baton: Using Simulation to Develop Student Collaboration , 2013 .

[18]  D. Prentice,et al.  Interprofessional Simulation: An Effective Training Experience for Health Care Professionals Working in Community Hospitals , 2011 .

[19]  Kristina Thomas Dreifuerst,et al.  Using debriefing for meaningful learning to foster development of clinical reasoning in simulation. , 2012, The Journal of nursing education.

[20]  P. Ravert,et al.  The Interpersonal Competence Instrument for Nurses , 1997 .

[21]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[22]  H. Yuan,et al.  A systematic review of selected evidence on improving knowledge and skills through high-fidelity simulation. , 2012, Nurse education today.

[23]  Jennifer Dempsey,et al.  The development and psychometric testing of the Satisfaction with Simulation Experience Scale. , 2011, Nurse education today.

[24]  G. I. Obrams,et al.  Clinical and Translational Science Awards , 2009 .

[25]  K. Birmingham What is translational research? , 2002, Nature Medicine.

[26]  C. Tanner The critical state of measurement in nursing education research. , 2011, The Journal of nursing education.

[27]  J. Roche,et al.  Human Patient Simulation Versus Written Case Studies for New Graduate Nurses in Nursing Orientation: A Pilot Study , 2013 .

[28]  A. Reinhardt,et al.  IV Insertion Simulation: Confidence, Skill, and Performance , 2012 .

[29]  K. Adamson,et al.  BSN Medical-Surgical Student Ability to Perform CPR in a Simulation: Recommendations and Implications , 2009 .

[30]  K. Adamson,et al.  A Review of Currently Published Evaluation Instruments for Human Patient Simulation , 2010 .

[31]  M. Woo,et al.  The effect of human patient simulation on critical thinking and its predictors in prelicensure nursing students. , 2013, Nurse education today.

[32]  Diane K. Brown,et al.  The Effect of Simulation Learning on Critical Thinking and Self-confidence When Incorporated Into an Electrocardiogram Nursing Course , 2009 .

[33]  Linda K. Fluharty,et al.  A Multisite, Multi–Academic Track Evaluation of End-of-Life Simulation for Nursing Education , 2012 .

[34]  C. Swenty,et al.  The Evaluation of Simulation in a Baccalaureate Nursing Program , 2011 .

[35]  N. Allison,et al.  Evaluation of a combat medic skills validation test. , 2007, Military medicine.

[36]  H. Connors,et al.  The Effect of Simulation on Clinical Performance: A Junior Nursing Student Clinical Comparison Study , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[37]  B. Aronson,et al.  Effectiveness of a Role-Modeling Intervention on Student Nurse Simulation Competency , 2013 .

[38]  A. Nishisaki,et al.  Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. , 2010, Resuscitation.

[39]  B. Aronson,et al.  Competency Assessment in Simulated Response to Rescue Events , 2012 .

[40]  K. Haller,et al.  Using Research in Practice , 1986 .

[41]  K. Adamson Piloting a Method for Comparing Two Experiential Teaching Strategies , 2012 .

[42]  Jacqueline Moss,et al.  Using Video-Facilitated Feedback to Improve Student Performance Following High-Fidelity Simulation , 2010 .

[43]  Eric S. Holmboe,et al.  Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. , 2009, JAMA.

[44]  Mary Elizabeth “Betsy” Guimond,et al.  Development of the Obstetric Nursing Self-Efficacy Scale Instrument , 2012 .

[45]  Shelly J. Reed Debriefing Experience Scale: Development of a Tool to Evaluate the Student Learning Experience in Debriefing , 2012 .

[46]  L. Kimble,et al.  Human patient simulation evaluation rubrics for nursing education: measuring the Essentials of Baccalaureate Education for Professional Nursing Practice. , 2011, The Journal of nursing education.

[47]  Mary Cazzell,et al.  Using Objective Structured Clinical Evaluation for Simulation Evaluation: Checklist Considerations for Interrater Reliability , 2012 .

[48]  P. Conway,et al.  The "3T's" road map to transform US health care: the "how" of high-quality care. , 2008, JAMA.

[49]  K. Radhakrishnan,et al.  Measuring Clinical Practice Parameters with Human Patient Simulation: A Pilot Study , 2007, International journal of nursing education scholarship.

[50]  Brenda S. Bray,et al.  Assessment of Human Patient Simulation-Based Learning , 2011, American Journal of Pharmaceutical Education.

[51]  K. Adamson,et al.  Assessing the reliability, validity, and use of the Lasater Clinical Judgment Rubric: three approaches. , 2012, The Journal of nursing education.

[52]  M. Cantrell,et al.  Structured Debriefing and Students' Clinical Judgment Abilities in Simulation , 2013 .

[53]  Andrea Dodge Ackermann,et al.  Investigation of Learning Outcomes for the Acquisition and Retention of CPR Knowledge and Skills Learned with the Use of High-Fidelity Simulation , 2009 .

[54]  S. Woolf The meaning of translational research and why it matters. , 2008, JAMA.

[55]  Nick Sevdalis,et al.  Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses. , 2009, International journal of nursing studies.

[56]  F. D. dela Cruz,et al.  Validating the Interpersonal Communication Assessment Scale. , 2006, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[57]  Dimitrios Stefanidis,et al.  Evaluating the Impact of Simulation on Translational Patient Outcomes , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[58]  Abeer Selim,et al.  Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education: is it reliable and valid? , 2012, Nurse education today.

[59]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[60]  Susanna R. Cohen,et al.  PRONTO2: Development, Implementation and Evaluation of an In-situ Multi-disciplinary, Low-Tech, High-Fidelity Obstetric Simulation Training for Mexico. , 2010 .

[61]  J. Korndorffer,et al.  Research Regarding Methods of Assessing Learning Outcomes , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[62]  K. Lasater Clinical judgment development: using simulation to create an assessment rubric. , 2007, The Journal of nursing education.

[63]  Martha Todd,et al.  The Development of a Quantitative Evaluation Tool for Simulations in Nursing Education , 2008, International journal of nursing education scholarship.