The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking.

[1]  Richard Fuller,et al.  How to measure the quality of the OSCE: A review of metrics – AMEE guide no. 49 , 2010, Medical teacher.

[2]  J. Norcini,et al.  A Comparison of the Characteristics and Examination Performances of U.S. and Non-U.S. Citizen International Medical Graduates who sought Educational Commission for Foreign Medical Graduates Certification: 1995–2004 , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Simone Scheffer Validierung des „Berliner Global Rating“ (BGR): ein Instrument zur Prüfung kommunikativer Kompetenzen Medizinstudierender imRahmen klinisch-praktischer Prüfungen (OSCE) , 2009 .

[4]  R. Reznick,et al.  An objective structured clinical examination for the licentiate: report of the pilot project of the Medical Council of Canada , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[5]  W. Woloschuk,et al.  Predicting Performance on the Medical Council of Canada Qualifying Exam Part II , 2013, Teaching and learning in medicine.

[6]  Brian Hodges,et al.  Analytic global OSCE ratings are sensitive to level of training , 2003, Medical education.

[7]  R. Harden,et al.  Assessment of clinical competence using objective structured examination. , 1975, British medical journal.

[8]  P. McCrorie,et al.  Variations in medical school graduating examinations in the United Kingdom: Are clinical competence standards comparable?* , 2009, Medical teacher.

[9]  S. Haist,et al.  The evolution of the United States Medical Licensing Examination (USMLE): enhancing assessment of practice-related competencies. , 2013, JAMA.

[10]  R. Bloch,et al.  Swiss Catalogue of Learning objectives for Undergraduate Medical Training , 2008 .

[11]  John R Boulet,et al.  Assessing the Underlying Structure of the United States Medical Licensing Examination Step 2 Test of Clinical Skills Using Confirmatory Factor Analysis , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[12]  Cees van der Vleuten,et al.  Comparison of a rational and an empirical standard setting procedure for an OSCE , 2003, Medical education.

[13]  J. Meyer,et al.  Qualitative research in health care: Using qualitative methods in health related action research , 2000 .

[14]  S. Feller,et al.  The new licencing examination for human medicine: from concept to implementation. , 2013, Swiss medical weekly.

[15]  Steven J. Durning,et al.  Changes in clinical skills education resulting from the introduction of the USMLE™ step 2 clinical skills (CS) examination , 2008, Medical teacher.

[16]  Lorelei Lingard,et al.  Grounded theory, mixed methods, and action research , 2008, BMJ : British Medical Journal.

[17]  Kamran Z Khan,et al.  The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part II: Organisation & Administration , 2013, Medical teacher.

[18]  Geoffrey R. Norman,et al.  Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method , 2006, Advances in health sciences education : theory and practice.

[19]  Carl Bereiter,et al.  Design Research for Sustained Innovation , 2002 .

[20]  Kamran Z Khan,et al.  The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective , 2013, Medical teacher.