ITEM ANALYSIS OF MULTIPLE CHOICE QUESTIONS

Any academic course or program is incomplete without an assessment plan. Of late, MCQs have been widely used for assessment of medical and dental undergraduate students. Often enough, poorly constructed MCQs are used that do not fulfil the requirement of an assessment. Therefore, it is necessary that quality of MCQs be frequently evaluated. A quality assessment of MCQs is known as “item analysis”. Item analysis allows identification of good-quality MCQs based on their Difficulty Index (DIF I/P), Discrimination Index (DI) and Distractor efficiency (DE). The aim of this paper was to conduct an item analysis to evaluate the quality of MCQs being used to assess final year BDS students in the subject of Prosthodontics. An internal assessment for the subject of Prosthodontics was undertaken by fifty dental undergraduate students of final year in March 2018. The test consisted of 40 ‘one best type’ MCQs, each with four options a – d. Post-validation of the test was done by item analysis. Data were analyzed using SPSS version 24. Majority (52.5%) MCQs were “too difficult” with a Diff Index less than 30%. About 67.5% MCQs had a poor discrimination index (DI < 0.2). Of the 120 distractors, 62 (51.6%) were non-functional and only 5 MCQs had no non-functional distractors. It can be concluded that the items administered in this test need careful revision to improve their quality before using them in any future assessments.

[1]  Surya Kumar Namdeo,et al.  Item analysis of multiple choice questions from an assessment of medical students in Bhubaneswar, India , 2016 .

[2]  M. Iqbal,et al.  A Simplified MCQs Interpretation Guide for Faculty. , 2015, Journal of the College of Physicians and Surgeons--Pakistan : JCPSP.

[3]  Mozaffer Rahim Hingorjo,et al.  Analysis of one-best MCQs: the difficulty index, discrimination index and distractor efficiency. , 2012, JPMA. The Journal of the Pakistan Medical Association.

[4]  Nadia M Al-Wardy,et al.  Assessment methods in undergraduate medical education. , 2010, Sultan Qaboos University medical journal.

[5]  M. Tarrant,et al.  An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis , 2009, BMC medical education.

[6]  C. Peck Principles of sound assessment practice in Health Professions Education , 2017 .

[7]  Manisha R. Dhobale,et al.  ITEM ANALYSIS OF MCQS’ - MYTHS AND REALITIES WHEN APPLYING THEM AS AN ASSESSMENT TOOL FOR MEDICAL STUDENTS - , 2016 .

[8]  S. Lahiri,et al.  Analysis of Multiple Choice Questions ( MCQs ) : Item and Test Statistics from an assessment in a medical college of Kolkata , West Bengal , 2015 .

[9]  A. Shete,et al.  Item analysis: An evaluation of multiple choice questions in Physiology examination , 2015 .

[10]  Pradeep Kumar,et al.  Item and Test Analysis to Identify Quality Multiple Choice Questions (MCQs) from an Assessment of Medical Students of Ahmedabad, Gujarat , 2014, Indian journal of community medicine : official publication of Indian Association of Preventive & Social Medicine.

[11]  V. Mokhasi,et al.  Item Analysis of Multiple Choice Questions- An Assessment of the Assessment Tool. - , 2014 .

[12]  S. Tabish Assessment Methods in Medical Education , 2014 .