How we developed and piloted an electronic key features examination for the internal medicine clerkship based on a US national curriculum

Abstract Background: Key features examinations (KFEs) have been used to assess clinical decision making in medical education, yet there are no reports of an online KFE-based on a national curriculum for the internal medicine clerkship. What we did: The authors developed and pilot tested an electronic KFE based on the US Clerkship Directors in Internal Medicine core curriculum. Teams, with expert oversight and peer review, developed key features (KFs) and cases. Evaluation: The exam was pilot tested at eight medical schools with 162 third and fourth year medical students, of whom 96 (59.3%) responded to a survey. While most students reported that the exam was more difficult than a multiple choice question exam, 61 (83.3%) students agreed that it reflected problems seen in clinical practice and 51 (69.9%) students reported that it more accurately assessed the ability to make clinical decisions. Conclusions: The development of an electronic KFs exam is a time-intensive process. A team approach offers built-in peer review and accountability. Students, although not familiar with this format in the US, recognized it as authentically assessing clinical decision-making for problems commonly seen in the clerkship.

[1]  P. Hrynchak,et al.  Key‐feature questions for assessment of clinical reasoning: a literature review , 2014, Medical education.

[2]  D. Torre,et al.  How and Why Internal Medicine Clerkship Directors Use Locally Developed, Faculty-Written Examinations: Results of a National Survey , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Timothy J. Wood,et al.  How clinical features are presented matters to weaker diagnosticians , 2010, Medical education.

[4]  David L Buckeridge,et al.  Influence of physicians' management and communication ability on patients' persistence with antihypertensive medication. , 2010, Archives of internal medicine.

[5]  David L Buckeridge,et al.  Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. , 2007, JAMA.

[6]  G. Norman,et al.  How specific is case specificity? , 2006, Medical education.

[7]  Gordon Page,et al.  A practical guide to assessing clinical decision‐making skills using the key features approach , 2005, Medical education.

[8]  Matthias Holzer,et al.  A modified electronic key feature examination for undergraduate medical students: validation threats and opportunities , 2005, Medical teacher.

[9]  Geoffrey R Norman,et al.  Adapting the Key Features Examination for a clinical clerkship , 2002, Medical education.

[10]  G Bordage,et al.  Developing key‐feature problems and examinations to assess clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[11]  G Bordage,et al.  The Medical Council of Canada's key features project: a more valid written examination of clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.