Development and Validation of Two Instruments Measuring Intrinsic, Extraneous, and Germane Cognitive Load

Cognitive Load Theory is one of the most powerful research frameworks in educational research. Beside theoretical discussions about the conceptual parts of cognitive load, the main challenge within this framework is that there is still no measurement instrument for the different aspects of cognitive load, namely intrinsic, extraneous, and germane cognitive load. Hence, the goal of this paper is to develop a differentiated measurement of cognitive load. In Study 1 (N = 97), we developed and analyzed two strategies to measure cognitive load in a differentiated way: (1) Informed rating: We trained learners in differentiating the concepts of cognitive load, so that they could rate them in an informed way. They were asked then to rate 24 different learning situations or learning materials related to either high or low intrinsic, extraneous, or germane load. (2) Naïve rating: For this type of rating of cognitive load we developed a questionnaire with two to three items for each type of load. With this questionnaire, the same learning situations had to be rated. In the second study (N = between 65 and 95 for each task), we improved the instrument for the naïve rating. For each study, we analyzed whether the instruments are reliable and valid, for Study 1, we also checked for comparability of the two measurement strategies. In Study 2, we conducted a simultaneous scenario based factor analysis. The informed rating seems to be a promising strategy to assess the different aspects of cognitive load, but it seems not economic and feasible for larger studies and a standardized training would be necessary. The improved version of the naïve rating turned out to be a useful, feasible, and reliable instrument. Ongoing studies analyze the conceptual validity of this measurement with up to now promising results.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  John Sweller,et al.  Measuring cognitive load , 2018, Perspectives on Medical Education.

[3]  Jeffrey J. H. Cheung,et al.  Limitations of subjective cognitive load measures in simulation‐based procedural training , 2015, Medical education.

[4]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[5]  Tina Seufert,et al.  The effects of different levels of disfluency on learning outcomes and cognitive load , 2017 .

[6]  O. Bratfisch.  Perceived Item-Difficulty in Three Tests of Intellectual Performance Capacity. , 1972 .

[7]  J. Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Modality Principle in Multimedia Learning , 2005 .

[8]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[9]  T. Gog,et al.  Development of an instrument for measuring different types of cognitive load , 2013, Behavior Research Methods.

[10]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[11]  R. Mayer,et al.  Multimedia learning: Are we asking the right questions? , 1997 .

[12]  A. Baddeley.  Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[13]  R Goldstein,et al.  Effect of task difficulty and interstimulus interval on blink parameters. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  John Sweller,et al.  The Split-Attention Principle in Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[15]  D. Rumelhart.  Schemata: The Building Blocks of Cognition , 2017 .

[16]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[17]  R. Mayer,et al.  Aids to computer-based multimedia learning , 2002 .

[18]  Richard E. Mayer,et al.  Cognitive Load Theory: Techniques That Reduce Extraneous Cognitive Load and Manage Intrinsic Cognitive Load during Multimedia Learning , 2010 .

[19]  John Sweller,et al.  Cognitive Load Theory: New Conceptualizations, Specifications, and Integrated Research Perspectives , 2010 .

[20]  Paul Chandler,et al.  Contemporary cognitive load theory research: The good, the bad and the ugly , 2011, Comput. Hum. Behav..

[21]  John Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Split-Attention Principle in Multimedia Learning , 2005 .

[22]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[23]  Pieter Wouters,et al.  Learner Performance in Multimedia Learning Arrangements: An Analysis Across Instructional Approaches , 2009 .

[24]  J. Sweller.  Cognitive Load Theory: Cognitive Load Theory: Recent Theoretical Advances , 2010 .

[25]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[26]  B. Zimmerman.  Models of Self-Regulated Learning and Academic Achievement , 1989 .

[27]  J. Sweller.  Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load , 2010 .

[28]  T. Gog,et al.  Effects of pairs of problems and examples on task performance and different types of cognitive load , 2014 .

[29]  J. Flavell.  Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[30]  Richard E. Mayer,et al.  Principles for Managing Essential Processing in Multimedia Learning: Segmenting, Pre-training, and Modality Principles , 2005 .

[31]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[32]  Kurt VanLehn,et al.  A model of the self-explanation effect. , 1992 .

[33]  R. Mayer,et al.  Animations need narrations : an experimental test of a dual-coding hypothesis , 1991 .

[34]  J. D. Fletcher,et al.  The Multimedia Principle. , 2005 .

[35]  T. Jong.  Cognitive load theory, educational research, and instructional design: some food for thought , 2010 .

[36]  P. Chandler,et al.  Evidence for Cognitive Load Theory , 1991 .

[37]  W. Schnotz,et al.  A Reconsideration of Cognitive Load Theory , 2007 .

[38]  R. Catrambone,et al.  Can learning from molar and modular worked examples be enhanced by providing instructional explanations and prompting self-explanations? * , 2006 .

[39]  D. Leutner,et al.  Assessment of cognitive load in multimedia learning using dual-task methodology. , 2002, Experimental psychology.

[40]  Richard Catrambone,et al.  Designing Instructional Examples to Reduce Intrinsic Cognitive Load: Molar versus Modular Presentation of Solution Procedures , 2004 .

[41]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[42]  Ton de Jong,et al.  Learner vs. System Control in Using Online Support for Simulation-based Discovery Learning , 2001 .

[43]  R. Moreno.  Cognitive load theory: more food for thought , 2010 .

[44]  Paul Chandler,et al.  Levels of Expertise and Instructional Design , 1998, Hum. Factors.

[45]  John Sweller,et al.  The Modality Principle in Multimedia Learning , 2014, The Cambridge Handbook of Multimedia Learning.

[46]  Slava Kalyuga.  Cognitive Load Theory: How Many Types of Load Does It Really Need? , 2011 .

[47]  F. Paas,et al.  Instructional Efficiency: Revisiting the Original Construct in Educational Research , 2008 .

[48]  Katharina Scheiter,et al.  Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? , 2009, Comput. Hum. Behav..

[49]  Jörg Zumbach,et al.  Cognitive load in hypermedia reading comprehension: Influence of text type and linearity , 2008, Comput. Hum. Behav..

[50]  P. Chandler,et al.  Cognitive Load While Learning to Use a Computer Program , 1996 .

[51]  Günter Daniel Rey.  A Review of Research and a Meta-Analysis of the Seductive Detail Effect. , 2012 .

[52]  J. Sweller.  COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[53]  R. Moreno,et al.  Cognitive Load Theory: Cognitive Load Theory: Historical Development and Relation to Other Theories , 2010 .

[54]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[55]  R. Mayer,et al.  The instructive animation: helping students build connections between words and pictures in multimedia learning , 1992 .

[56]  Anique B. H. de Bruin,et al.  Bridging Cognitive Load and Self-Regulated Learning Research: A complementary approach to contemporary issues in educational research , 2017 .

[57]  Alexander Renkl,et al.  Assisting self-explanation prompts are more effective than open prompts when learning with multiple representations , 2009 .

[58]  Michael C. Rodriguez,et al.  Meta-analysis of coefficient alpha. , 2006, Psychological methods.

[59]  R. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[60]  Robert R. Whelan.  Neuroimaging of cognitive load in instructional multimedia , 2007 .

[61]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[62]  Paul Ayres.  Using subjective measures to detect variations of intrinsic cognitive load within problems , 2006 .

[63]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[64]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[65]  T. Gog,et al.  Optimising worked example instruction: Different ways to increase germane cognitive load. , 2006 .

[66]  Krista E. DeLeeuw,et al.  A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane Load , 2008 .

[67]  G. Salomon.  Television is "easy" and print is "tough": The differential investment of mental effort in learning as a function of perceptions and attributions. , 1984 .

[68]  A. Renkl,et al.  Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts , 2007 .

[69]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .