Measuring cognitive load in introductory CS: adaptation of an instrument

A student's capacity to learn a concept is directly related to how much cognitive load is used to comprehend the material. The central problem identified by Cognitive Load Theory is that learning is impaired when the total amount of processing requirements exceeds the limited capacity of working memory. Instruction can impose three different types of cognitive load on a student's working memory: intrinsic load, extraneous load, and germane load. Since working memory is a fixed size, instructional material should be designed to minimize the extraneous and intrinsic loads in order to increase the amount of memory available for the germane load. This will improve learning. To effectively design instruction to minimize cognitive load we must be able to measure the specific load components for any pedagogical intervention. This paper reports on a study that adapts a previously developed instrument to measure cognitive load. We report on the adaptation of the instrument to a new discipline, introductory computer science, and the results of measuring the cognitive load factors of specific lectures. We discuss the implications for the ability to measure specific cognitive load components and use of the tool in future studies.

[1]  P. Chandler,et al.  THE SPLIT‐ATTENTION EFFECT AS A FACTOR IN THE DESIGN OF INSTRUCTION , 1992 .

[2]  Phil Wood.  Confirmatory Factor Analysis for Applied Research , 2008 .

[3]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[4]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[5]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[6]  Katharina Scheiter,et al.  Eye tracking as a tool to study and enhance multimedia learning , 2010 .

[7]  Richard Catrambone,et al.  Designing Instructional Examples to Reduce Intrinsic Cognitive Load: Molar versus Modular Presentation of Solution Procedures , 2004 .

[8]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[9]  Fred G. W. C. Paas,et al.  The Efficiency of Instructional Conditions: An Approach to Combine Mental Effort and Performance Measures , 1992 .

[10]  P. Chandler,et al.  Cognitive Load While Learning to Use a Computer Program , 1996 .

[11]  R. Catrambone,et al.  Can learning from molar and modular worked examples be enhanced by providing instructional explanations and prompting self-explanations? * , 2006 .

[12]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[13]  Geoffrey Underwood,et al.  Inspecting Pictures for Information to Verify a Sentence: Eye Movements in General Encoding and in Focused Search , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[14]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[15]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[16]  J. Sweller,et al.  Locus of Difficulty in Multistage Mathematics Problems , 1990 .

[17]  G. Salomon.  Television is "easy" and print is "tough": The differential investment of mental effort in learning as a function of perceptions and attributions. , 1984 .

[18]  Paul Ayres.  Systematic Mathematical Errors and Cognitive Load. , 2001, Contemporary educational psychology.

[19]  F. Paas,et al.  Instructional Efficiency: Revisiting the Original Construct in Educational Research , 2008 .

[20]  Krista E. DeLeeuw,et al.  A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane Load , 2008 .

[21]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[22]  T. Gog,et al.  Development of an instrument for measuring different types of cognitive load , 2013, Behavior Research Methods.

[23]  Katharina Scheiter,et al.  Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? , 2009, Comput. Hum. Behav..

[24]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[25]  F. Paas,et al.  Modality and Variability as Factors in Training the Elderly , 2006 .

[26]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[27]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[28]  J. Sweller.  Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load , 2010 .

[29]  Natalie Ruiz.  Cognitive load measurement in multimodal interfaces , 2011 .

[30]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[31]  R. Moreno.  Decreasing Cognitive Load for Novice Students: Effects of Explanatory versus Corrective Feedback in Discovery-Based Multimedia , 2004 .

[32]  Pavlo D. Antonenko,et al.  The influence of leads on cognitive load and learning in a hypertext environment , 2010, Comput. Hum. Behav..

[33]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[34]  J. Sweller,et al.  Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions , 2005 .

[35]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[36]  F. Paas,et al.  Measurement of Cognitive Load in Instructional Research , 1994, Perceptual and motor skills.

[37]  R. Purc-Stephenson,et al.  Reporting practices in confirmatory factor analysis: an overview and some recommendations. , 2009, Psychological methods.

[38]  Paul Ayres.  Using subjective measures to detect variations of intrinsic cognitive load within problems , 2006 .

[39]  Roland Brünken,et al.  Cognitive Load Theory: Frontmatter , 2010 .

[40]  Robert R. Whelan.  Neuroimaging of cognitive load in instructional multimedia , 2007 .

[41]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[42]  T. Gog,et al.  Effects of pairs of problems and examples on task performance and different types of cognitive load , 2014 .

[43]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .