Measuring cognitive load in test items: static graphics versus animated graphics

The majority of multimedia learning studies focus on the use of graphics in learning process but very few of them examine the role of graphics in testing students' knowledge. This study investigates the use of static graphics versus animated graphics in a computer-based English achievement test from a cognitive load theory perspective. Three hundred and three 7th-grade students were randomly split into two groups and given the test questions either with static graphics or with animated graphics accompanied with text. Students' response time, response accuracy, self-reported ratings on cognitive load and secondary task approach were used to measure their cognitive load. Findings revealed that animating graphics increased the response time and secondary task scores of the students but did not have any significant effect on their test success. Furthermore, no difference was observed in self-reported cognitive loads. The relationship between the four different cognitive load measures was also examined in the study. No direct relation was found between self-reported ratings and secondary task scores. On the other hand, self-ratings and response accuracy were found to be more sensitive to intrinsic cognitive load, whereas response time and secondary task measures were found to be more sensitive to extraneous cognitive load in our testing environment.

[1]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[2]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[3]  Krista E. DeLeeuw,et al.  A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane Load , 2008 .

[4]  Merrilyn Goos,et al.  Navigating Currents and Charting Directions. Proceedings of the Annual Conference of the Mathematics Education Research Group of Australasia (31st, Brisbane, Queensland, Australia, June 28-July 1, 2008). Volumes 1 and 2. , 2008 .

[5]  Norman Edward Gronlund,et al.  Assessment of student achievement , 1997 .

[6]  Safiye Aslan,et al.  Hiper Ortamlarda Öğrencilerin Bilişsel Yüklenme ve Kaybolma Düzeylerinin Belirlenmesi , 2016 .

[7]  Elizabeth J Marsh,et al.  The positive and negative consequences of multiple-choice testing. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[8]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[9]  B. Mavis,et al.  A Survey of Student Assessment in U.S. Medical Schools: The Balance of Breadth Versus Fidelity , 2001, Teaching and learning in medicine.

[10]  W. Schnotz,et al.  A Reconsideration of Cognitive Load Theory , 2007 .

[11]  P. Chandler,et al.  Cognitive Load While Learning to Use a Computer Program , 1996 .

[12]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[13]  Roland Brünken,et al.  Role of dual task design when measuring cognitive load during multimedia learning , 2012, Educational Technology Research and Development.

[14]  Mari Carmen Puerta Melguizo,et al.  The effects of the number of links and navigation support on cognitive load and learning with hypertext: The mediating role of reading order , 2009, Comput. Hum. Behav..

[15]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[16]  Melissa H. Dancy,et al.  Impact of Animation on Assessment of Conceptual Understanding in Physics , 2006 .

[17]  J. D. Fletcher,et al.  The Multimedia Principle. , 2005 .

[18]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[19]  D. Leutner,et al.  Assessment of cognitive load in multimedia learning using dual-task methodology. , 2002, Experimental psychology.

[20]  Yeung,et al.  Cognitive Load and Learner Expertise: Split-Attention and Redundancy Effects in Reading with Explanatory Notes , 1998, Contemporary educational psychology.

[21]  Richard B Gunderman,et al.  Inherent limitations of multiple-choice testing. , 2013, Academic radiology.

[22]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[23]  Kian Sam Hong,et al.  Guessing, Partial Knowledge, and Misconceptions in Multiple-Choice Tests , 2011, J. Educ. Technol. Soc..

[24]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[25]  Carmel M. Diezmann,et al.  National Numeracy Tests: A Graphic Tells a Thousand Words , 2009 .

[26]  Detlev Leutner,et al.  Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities , 2003, Comput. Hum. Behav..

[27]  F. Paas,et al.  Modality and Variability as Factors in Training the Elderly , 2006 .

[28]  P. Chandler,et al.  Assimilating complex information , 2002 .

[29]  Mark G. Simkin,et al.  Multiple-Choice Tests and Student Understanding: What Is the Connection? , 2005 .

[30]  Jörg Wittwer,et al.  Pictures in Test Items: Effects on Response Time and Response Correctness , 2012 .

[31]  Sharon K Tindall-Ford,et al.  Learning by imagining. , 2001, Journal of experimental psychology. Applied.

[32]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[33]  K. Scouller.  The influence of assessment method on students' learning approaches: Multiple choice question examination versus assignment essay , 1998 .

[34]  Fred Paas,et al.  Cognitive Load Theory: Measuring Cognitive Load , 2010 .

[35]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[36]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[37]  F. Paas,et al.  Measurement of Cognitive Load in Instructional Research , 1994, Perceptual and motor skills.

[38]  David Nunan,et al.  The Self-Directed Teacher: Managing the Learning Process. , 1996 .

[39]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[40]  M. Rinck,et al.  Multimedia learning: Working memory and the learning of word and picture diagrams , 2006 .

[41]  J. G. Schuurman,et al.  Redirecting learners' attention during training: Effects on cognitive load, transfer test performance and training efficiency. , 2002 .

[42]  John Sweller,et al.  Instructional Design in Technical Areas , 1999 .

[43]  A. Baddeley.  Is working memory still working , 2001 .

[44]  Russell N. Carney,et al.  Pictorial Illustrations Still Improve Students' Learning from Text , 2002 .

[45]  Joanna Bull,et al.  A Blueprint for Computer-Assisted Assessment , 2003 .

[46]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[47]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[48]  D. Nicol.  E‐assessment by design: using multiple‐choice tests to good effect , 2007 .

[49]  T. Tombaugh.  Trail Making Test A and B: normative data stratified by age and education. , 2004, Archives of Clinical Neuropsychology.

[50]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[51]  Fred G. W. C. Paas,et al.  The Efficiency of Instructional Conditions: An Approach to Combine Mental Effort and Performance Measures , 1992 .