Reducing the number of options on multiple‐choice questions: response time, psychometrics and standard setting

Despite significant evidence supporting the use of three‐option multiple‐choice questions (MCQs), these are rarely used in written examinations for health professions students. The purpose of this study was to examine the effects of reducing four‐ and five‐option MCQs to three‐option MCQs on response times, psychometric characteristics, and absolute standard setting judgements in a pharmacology examination administered to health professions students.

[1]  Gregory J. Cizek,et al.  Further Investigation of Nonfunctioning Options in Multiple-Choice Test Items , 1994 .

[2]  T. Haladyna,et al.  How Many Options is Enough for a Multiple-Choice Test Item? , 1993 .

[3]  T. Haladyna,et al.  Validity of a Taxonomy of Multiple-Choice Item-Writing Rules. , 1989 .

[4]  S. Downing,et al.  Setting Standards for Performance Tests: A Pilot Study of a Three-Level Angoff Method , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[5]  Brian E Clauser,et al.  Psychometric Characteristics and Response Times for One-Best-Answer Questions in Relation to Number and Source of Options , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[6]  S. Downing.  Validity: on the meaningful interpretation of assessment data , 2003, Medical education.

[7]  Michael G. Aamodt,et al.  A Meta-Analytic Investigation of the Effect of Various Test Item Characteristics on Test Scores and Test Completion Times , 1992 .

[8]  Measurement Characteristics of Content-Parallel Single-Best-Answer and Extended-Matching Questions in Relation to Number and Source of Options , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Steven M. Downing,et al.  Assessment in Health Professions Education , 2009 .

[10]  S. Downing.  Threats to the Validity of Locally Developed Multiple-Choice Tests in Medical Education: Construct-Irrelevant Variance and Construct Underrepresentation , 2002, Advances in health sciences education : theory and practice.

[11]  W. McGaghie,et al.  Simulations in Assessment , 2009, Assessment in Health Professions Education.

[12]  Barbara S. Plake,et al.  Standard Setting: An Alternative Approach , 1997 .

[13]  What's Wrong with Three-Option Multiple Choice Items? , 1987 .

[14]  Michael C. Rodriguez.  Three Options Are Optimal for Multiple‐Choice Items: A Meta‐Analysis of 80 Years of Research , 2005 .