A new multiple choice test format is presented that allows examinees to select more than one answer to a question if they are uncertain of the correct one. Negative marking is used to penalise incorrect selections. The aim is to explicitly reward examinees who possess partial knowledge as compared with those who are simply guessing. The result is a test method that forces examinees to think more carefully about their answers, and that yields results of a higher resolution than standard multiple choice tests. After describing the new format, the paper presents and critiques several existing methods which have the same or similar aims. The paper ends with a discussion of the feedback and experience gained to date in using the new format.
[1]
A. R. Gardner-Medwin,et al.
Confidence assessment in the teaching of basic science
,
1995
.
[2]
Harry Torrance,et al.
Assessment and Testing: A Survey of Research
,
1993
.
[3]
Michael Akeroyd.
Progress in Multiple Choice Scoring Methods, 1977/81
,
1982
.
[4]
Clyde H. Coombs,et al.
The Assessment of Partial Knowledge1
,
1956
.
[5]
Dave W. Farthing,et al.
Permutational multiple-choice questions: an objective and efficient alternative to essay-type examination questions
,
1998,
ITiCSE '98.
[6]
David A. Bradbard,et al.
Use of the Coombs Elimination Procedure in Classroom Tests
,
1986
.