Effects of Reducing the Cognitive Load of Mathematics Test Items on Student Performance

This study explores a new item-writing framework for improving the validity of math assessment items. The authors transfer insights from Cognitive Load Theory (CLT), traditionally used in instructional design, to educational measurement. Fifteen, multiple-choice math assessment items were modified using researchbased strategies for reducing extraneous cognitive load. An experimental design with 222 middle-school students tested the effects of the reduced cognitive load items on student performance and anxiety. Significant findings confirm the main research hypothesis that reducing the cognitive load of math assessment items improves student performance. Three load-reducing item modifications are identified as particularly effective for reducing item difficulty: signalling important information, aesthetic item organization, and removing extraneous content. Load reduction was not shown to impact student anxiety. Implications for classroom assessment and future research are discussed.

[1]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  Charles P. Bernacchio,et al.  Universal design for learning. , 2007, Psychiatric rehabilitation journal.

[3]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[4]  Douglas R. Glasnapp,et al.  The Impact of Language Characteristics in Mathematics Test Items on the Performance of English Language Learners and Students With Disabilities , 2006 .

[5]  Charles Miller.  Aesthetics and e-assessment: the interplay of emotional design and learner performance , 2011 .

[6]  B. Frey,et al.  Item-writing rules: Collective wisdom , 2005 .

[7]  Misook Heo,et al.  The Impact of Computer Augmented Online Learning and Assessment Tool , 2005, J. Educ. Technol. Soc..

[8]  Michael C. Rodriguez,et al.  A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment , 2002 .

[9]  Maria Bannert,et al.  Managing Cognitive Load--Recent Trends in Cognitive Load Theory. Commentary. , 2002 .

[10]  D. Eignor.  The standards for educational and psychological testing. , 2013 .

[11]  Peter A. Beddow,et al.  Modifying Achievement Test Items: A Theory-Guided and Data-Based Approach for Better Measurement of What Students With Disabilities Know , 2009 .

[12]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[13]  John Sweller,et al.  Cognitive technology: Some procedures for facilitating learning and problem solving in mathematics and science. , 1989 .

[14]  Michael C. Rodriguez,et al.  Modified Multiple-Choice Items for Alternate Assessments: Reliability, Difficulty, and Differential Boost , 2011 .

[15]  Joanna S. Gorin,et al.  Item Diffficulty Modeling of Paragraph Comprehension Items , 2006 .

[16]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[17]  John Sweller,et al.  Efficiency in Learning: Evidence-Based Guidelines to Manage Cognitive Load , 2005 .

[18]  Jacqueline Bichsel,et al.  Anxiety, working memory, gender, and math performance , 2004 .

[19]  Bettina Seipp.  Anxiety and academic performance: A meta-analysis of findings , 1991 .

[20]  Chi-Cheng Chang,et al.  Cognitive Load Theory: An Empirical Study of Anxiety and Task Performance in Language Learning , 2017 .

[21]  S. Embretson,et al.  Component Latent Trait Models for Paragraph Comprehension Tests , 1987 .

[22]  S. N. Beretvas,et al.  Effects of linguistic complexity and accommodations on estimates of ability for students with learning disabilities. , 2012, Journal of school psychology.

[23]  C. Grillon,et al.  Describing the interplay between anxiety and cognition: from impaired performance under low cognitive load to reduced anxiety under high load. , 2012, Psychophysiology.

[24]  Maria Martiniello,et al.  Language and the Performance of English-Language Learners in Math Word Problems. , 2008 .

[25]  G. Hitch.  The role of short-term working memory in mental arithmetic , 1978, Cognitive Psychology.

[26]  Denisse R. Thompson,et al.  Assessments: Numbers, Context, Graphics, and Assumptions. , 2013 .

[27]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[28]  M. Ashcraft,et al.  The relationships among working memory, math anxiety, and performance. , 2001, Journal of experimental psychology. General.

[29]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[30]  Richard E. Mayer,et al.  Cognitive Load Theory: Techniques That Reduce Extraneous Cognitive Load and Manage Intrinsic Cognitive Load during Multimedia Learning , 2010 .