Assessment of student competency in a simulated speech-language pathology clinical placement

Abstract Clinical education programs in speech-language pathology enable the transition of students’ knowledge and skills from the classroom to the workplace. Simulated clinical learning experiences provide an opportunity to address the competency development of novice students. This study reports on the validation of an assessment tool designed to evaluate speech-language pathology students’ performance in a simulated clinical placement. The Assessment of Foundation Clinical Skills (AFCS) was designed to link to concepts and content of COMPASS®: Competency Assessment in Speech Pathology, a validated assessment of performance in the workplace. It incorporates units and elements of competency relevant to the placement. The validity of the AFCS was statistically investigated using Rasch analysis. Participants were 18 clinical educators and 130 speech-language pathology students undertaking the placement. Preliminary results support the validity of the AFCS as an assessment of foundation clinical skills of students in this simulated clinical placement. All units of competency and the majority of elements were relevant and representative of these skills. The use of a visual analogue scale which included a pre-Novice level to rate students’ performance on units of competency was supported. This research provides guidance for development of quality assessments of performance in simulated placements.

[1]  L. McAllister,et al.  Sources of Anxiety Related to Clinical Education in Undergraduate Speech-Language Pathology Students , 1994 .

[2]  P. Benner.  From novice to expert. , 1984, The American journal of nursing.

[3]  A. Ferguson,et al.  Issues in developing valid assessments of speech pathology students' performance in the workplace. , 2009, International journal of language & communication disorders.

[4]  P. Bradley.  The history of simulation in medical education and possible future directions , 2006, Medical education.

[5]  Helen Edwards,et al.  Using simulated patients to teach clinical reasoning , 2000 .

[6]  S. Mcallister.  Competency based assessment of speech pathology students' performance in the workplace , 2005 .

[7]  Shelley B Brundage,et al.  Formative feedback, rubrics, and assessment of professional competency through a speech-language pathology graduate program. , 2010, Journal of allied health.

[8]  D. Morris,et al.  Competency-Based Early Clinical Education Experiences for Physical Therapy Students. , 2006 .

[9]  Lindy McAllister,et al.  Issues and innovations in clinical education , 2005 .

[10]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[11]  Richard I. Zraick,et al.  The Use of Standardized Patients To Teach and Test Interpersonal and Communication Skills with Students in Speech-Language Pathology , 2003, Advances in health sciences education : theory and practice.

[12]  S. Edmond,et al.  The Use of Standardized Patients in Physical Therapist Education Programs , 2009 .

[13]  D. Theodoros,et al.  A review of standardized patients in clinical education: Implications for speech-language pathology programs , 2010, International journal of speech-language pathology.

[14]  M. R. Espejo.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2004 .

[15]  A. Ferguson,et al.  A systematic program of research regarding the assessment of speech-language pathology competencies , 2011, International journal of speech-language pathology.

[16]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[17]  D Syder.  The use of simulated clients to develop the clinical skills of speech and language therapy students. , 1996, European journal of disorders of communication : the journal of the College of Speech and Language Therapists, London.

[18]  D. Theodoros,et al.  The performance of standardized patients in portraying clinical scenarios in speech-language therapy. , 2013, International journal of language & communication disorders.

[19]  D. Beglar.  A Rasch-based validation of the Vocabulary Size Test , 2010 .

[20]  R. Zraick.  Review of the use of standardized patients in speech-language pathology clinical education , 2012 .

[21]  L. Togher,et al.  An international study of clinical education practices in speech-language pathology , 2011, International journal of speech-language pathology.

[22]  E. Wolfe.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences [book review]. , 2002 .

[23]  Anthony Paré,et al.  Learning in two communities: the challenge for universities and workplaces , 2004 .

[24]  M. Engardt,et al.  Early learning experiences valued by physiotherapy students , 2004 .

[25]  S. Lurie,et al.  History and practice of competency‐based assessment , 2012, Medical education.

[26]  Carl W. Swartz,et al.  Optimizing Rating Scales for Self-Efficacy (and Other) Research , 2003 .

[27]  Kathryn M. Yorkston,et al.  An introduction to item response theory and Rasch models for speech-language pathologists. , 2011, American journal of speech-language pathology.

[28]  Using Rasch analysis to establish the construct validity of rehabilitation assessment tools , 2009 .

[29]  S. Billett.  Integrating experiences in workplace and university settings: A conceptual perspective , 2011 .

[30]  Stephen Rollnick,et al.  The use of simulated patients and role-play in communication skills training: a review of the literature to August 2005. , 2007, Patient education and counseling.

[31]  Debra Sellheim,et al.  Linking the Classroom and the Clinic: A Model of Integrated Clinical Education for First‐Year Physical Therapist Students , 2011 .

[32]  J. Norcini,et al.  Workplace-based assessment as an educational tool: AMEE Guide No. 31 , 2007, Medical teacher.

[33]  John M Linacre,et al.  Optimizing rating scale category effectiveness. , 2002, Journal of applied measurement.

[34]  Vanessa C. Burch,et al.  Workplace-based assessment as an educational tool , 2007 .

[35]  A. Ferguson,et al.  COMPASS: Competency assessment in speech pathology , 2006 .

[36]  H. Barrows.  Simulated patients (programmed patients) : the development and use of a new technique in medical education , 1971 .