This is only a test: a machine-graded improvement to the multiple-choice and true-false examination

The primary goal of teaching is to successfully facilitate learning. Testing can help accomplish this goal in two ways. First, testing can provide a powerful motivation for students to prepare when they perceive that the effort involved leads to valued outcomes. Second, testing can provide instructors with valuable feedback on whether their teaching resulted in the learning desired. It is in the process of creating test questions that the test's value is determined. After reviewing the different types of questions available to educators, we introduce a new approach that can improve the nature of testing. We report on the use of this approach and provide preliminary analysis of its impact in the classroom. We conclude with a discussion of the implications of this approach as well as recommendations for its future development and use in academia.

[1]  K. Scouller.  The influence of assessment method on students' learning approaches: Multiple choice question examination versus assignment essay , 1998 .

[2]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[3]  David Dibattista *,et al.  Acceptance by undergraduates of the immediate feedback assessment technique for multiple‐choice testing , 2004 .

[4]  Richard F. Burton,et al.  Quantifying the Effects of Chance in Multiple Choice and True/False Tests: Question selection and guessing of answers , 2001 .

[5]  Jeremy B. Williams,et al.  Assertion‐reason multiple‐choice testing as a tool for deep learning: a qualitative analysis , 2006 .

[6]  Timothy L. Shaftel,et al.  Educational Assessment and the AACSB , 2007 .

[7]  P. Tamir,et al.  The Class-Size Effect upon Activity and Cognitive Dimensions of Lessons in Higher Education. , 1986 .

[8]  G. Gibbs,et al.  Conditions Under Which Assessment Supports Students’ Learning , 2005 .

[9]  Lewis Elton,et al.  Trends in research on student learning , 1979 .

[10]  David E. Stout,et al.  Answer-Choice Bias and Test-Item Sequencing: Review, Test Construction, and Future Research. , 1990 .

[11]  M. Paxton.  A Linguistic Perspective on Multiple Choice Questioning , 2000 .

[12]  John R. Schermerhorn,et al.  Success Profiles for Student Examination Performance in a Large-Lecture Management Course: An Empirical Study , 1992 .

[13]  S. Kerr.  On the folly of rewarding A, while hoping for B. , 1975 .

[14]  Brenda Reeb,et al.  Association to Advance Collegiate Schools of Business (AACSB) , 2005 .

[15]  Alan S. Brown,et al.  The negative suggestion effect: Pondering incorrect alternatives may be hazardous to your knowledge. , 1999 .

[16]  Elizabeth J Marsh,et al.  The positive and negative consequences of multiple-choice testing. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Thomas L. Keon,et al.  Summary of Assessment in Higher Education and the Management of Student-Learning Data , 2008 .

[18]  B. Kniveton,et al.  A correlational analysis of multiple-choice and essay assessment measures , 1996 .

[19]  Thomas C. Toppino,et al.  Generality of the Negative Suggestion Effect in Objective Tests. , 1993 .

[20]  P. Connor-Greene,et al.  Assessing and Promoting Student Learning: Blurring the Line between Teaching and Testing , 2000 .

[21]  G. Brosvic,et al.  Immediate Feedback Assessment Technique Promotes Learning and Corrects Inaccurate first Responses , 2002 .

[22]  C. Miller,et al.  Up to the Mark: A Study of the Examination Game. , 1974 .

[23]  Steven Kerr,et al.  AN ACADEMY CLASSIC On the folly of rewarding A, while hoping for B , 1995 .

[24]  David L. Duhon,et al.  Evaluating and Improving Student Achievement in Business Programs: The Effective Use of Standardized Assessment Tests , 2003 .

[25]  Michael E. Martinez.  Cognition and the question of test item format , 1999 .

[26]  G. Brosvic,et al.  Immediate Feedback during Academic Testing , 2001, Psychological reports.

[27]  Elizabeth J Marsh,et al.  The memorial consequences of multiple-choice testing , 2007, Psychonomic bulletin & review.

[28]  Christina T. Fong,et al.  The End of Business Schools? Less Success Than Meets the Eye , 2002 .