Blended Simulation Progress Testing for Assessment of Practice Readiness

Objective. To design an assessment of practice readiness using blended-simulation progress testing. Design. A five-station, blended simulation assessment was developed to evaluate patient care outcomes in first- and third-year pharmacy (P1 and P3) students, as well as first-year postgraduate (PGY1) pharmacy residents. This assessment of practice readiness included knowledge and performance evaluations administered as a progress test. Assessment. Eighteen PGY1 residents, 108 P3 students, and 106 P1 students completed the assessment. P3 students scored significantly higher than P1 students across all evaluations. Third-year pharmacy students scored significantly lower than PGY1 residents in interprofessional communications and attitudes of ownership in a standardized colleague/mannequin model station, and in patient communication in a standardized patient station. Conclusion. Learners demonstrated evolving skills as they progressed through the curriculum. A blended simulation integrated progress test provides data for improvement of individual student clinical skills, informs curricular advancement, and aligns curricular content, process, and outcomes with accreditation standards.

[1]  Ronald E. Ragan,et al.  An Assessment Program Using Standardized Clients to Determine Student Readiness for Clinical Practice , 2013, American Journal of Pharmaceutical Education.

[2]  P. Jeffries,et al.  The NCSBN National Simulation Study: A Longitudinal, Randomized, Controlled Study Replacing Clinical Hours with Simulation in Prelicensure Nursing Education , 2014 .

[3]  Yvonne Steinert,et al.  Amending Miller’s Pyramid to Include Professional Identity Formation , 2016, Academic medicine : journal of the Association of American Medical Colleges.

[4]  J. McGill,et al.  AACE comprehensive diabetes management algorithm 2013. , 2013, Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists.

[5]  A. Mcewen.  Teachers’ values: a case study of Northern Ireland teachers , 1985 .

[6]  Neal Benedict,et al.  TEACHERS' TOPICS Virtual Patients and Problem-Based Learning in Advanced Therapeutics , 2010 .

[7]  Functions and structure of a Medical School. , 1974, Connecticut medicine.

[8]  Neal Benedict,et al.  Promotion of Self-directed Learning Using Virtual Patient Cases , 2013, American Journal of Pharmaceutical Education.

[9]  Gordon Page,et al.  A practical guide to assessing clinical decision‐making skills using the key features approach , 2005, Medical education.

[10]  L W T Schuwirth,et al.  The use of clinical simulations in assessment , 2003, Medical education.

[11]  K. Parakh.  Assessment in medical education. , 2007, The New England journal of medicine.

[12]  G. Norman,et al.  Introducing progress testing in McMaster University's problem‐based medical curriculum: psychometric properties and effect on learning , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[13]  Brian Hodges,et al.  Medical education and the maintenance of incompetence , 2006, Medical teacher.

[14]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[15]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[16]  C. Pugh,et al.  Use of decision-based simulations to assess resident readiness for operative independence. , 2015, American journal of surgery.

[17]  Vicki L. Schmitt,et al.  Defining Authentic Classroom Assessment. , 2012 .

[18]  Paul Ogden,et al.  What can medical education learn from the neurobiology of learning? , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[19]  Fred M. Newmann.  Research news and Comment: An Exchange of Views on “Semantics, Psychometrics, and Assessment Reform: A Close Look at ‘Authentic’ Assessments” , 1998 .

[20]  Neal Benedict,et al.  Patient Simulation Software to Augment an Advanced Pharmaceutics Course , 2011, American Journal of Pharmaceutical Education.

[21]  Roxane Gardner,et al.  Using the Communication and Teamwork Skills (CATS) Assessment to measure health care team performance. , 2007, Joint Commission journal on quality and patient safety.

[22]  Melissa S Medina,et al.  Center for the Advancement of Pharmacy Education 2013 Educational Outcomes , 2013, American Journal of Pharmaceutical Education.

[23]  H. V. Berkel.  Assessment in a problem-based medical curriculum , 1990 .

[24]  G. Miller.  The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[25]  W. Wrigley,et al.  A systemic framework for the progress test: Strengths, constraints and issues: AMEE Guide No. 71 , 2012, Medical teacher.

[26]  G Bordage,et al.  Developing key‐feature problems and examinations to assess clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[27]  Amy L. Seybert,et al.  Human patient simulation in a pharmacotherapy course. , 2008, American journal of pharmaceutical education.

[28]  Jon Mueller,et al.  The Authentic Assessment Toolbox: Enhancing Student Learning through Online Faculty Development , 2005 .

[29]  Amy L. Seybert,et al.  Pharmacy student response to patient-simulation mannequins to teach performance-based pharmacotherapeutics. , 2006, American journal of pharmaceutical education.

[30]  N. Winslade.  A System to Assess the Achievement of Doctor of Pharmacy Students 1 , 2001 .