The Role of Working Memory in Multimedia Instruction: Is Working Memory Working During Learning from Text and Pictures?

A lot of research has focused on the beneficial effects of using multimedia, that is, text and pictures, for learning. Theories of multimedia learning are based on Baddeley’s working memory model (Baddeley 1999). Despite this theoretical foundation, there is only little research that aims at empirically testing whether and more importantly how working memory contributes to learning from text and pictures; however, a more thorough understanding of how working memory limitations affect learning may help instructional designers to optimize multimedia instruction. Therefore, the goal of this review is to stimulate such empirical research by (1) providing an overview of the methodologies that can be applied to gain insights in working memory involvement during multimedia learning, (2) reviewing studies that have used these methodologies in multimedia research already, and (3) discussing methodological and theoretical challenges of such an approach as well as the usefulness of working memory to explain learning with multimedia.

[1]  Murray Dj The role of speech responses in short-term memory. , 1967 .

[2]  E. Farmer,et al.  Evidence for a Visuo-Spatial Scratch-Pad in Working Memory , 1986 .

[3]  T. Salthouse,et al.  Why is working memory related to fluid intelligence? , 2008, Psychonomic bulletin & review.

[4]  R. Logie,et al.  Visuo-spatial working memory: Visual, spatial, or central executive? , 1991 .

[5]  Valérie Gyselinck,et al.  Visuospatial memory and phonological loop in learning from multimedia , 2002 .

[6]  A Baddeley,et al.  Random Generation and the Executive Control of Working Memory , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[7]  D. Norman,et al.  Attention to action: Willed and automatic control , 1980 .

[8]  Edward E. Smith,et al.  Working Memory: A View from Neuroimaging , 1997, Cognitive Psychology.

[9]  A. Baddeley Exploring the Central Executive , 1996 .

[10]  J. Myerson,et al.  The effects of eye and limb movements on working memory. , 2001, Memory.

[11]  J. Sweller Implications of Cognitive Load Theory for Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[12]  Robert Zheng,et al.  Cognitive Effects of Multimedia Learning , 2008 .

[13]  Francesca Pazzaglia,et al.  The specific involvement of verbal and visuospatial working memory in hypermedia learning , 2008, Br. J. Educ. Technol..

[14]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[15]  [Italian standardization and classification of Neuropsychological tests. The Italian Group on the Neuropsychological Study of Aging]. , 1987, Italian journal of neurological sciences.

[16]  R. Engle,et al.  Is working memory capacity task dependent , 1989 .

[17]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[18]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[19]  Katherine A. Austin Multimedia learning: Cognitive individual differences and display design techniques predict transfer learning with multimedia learning modules , 2009, Comput. Educ..

[20]  Andrew R. A. Conway,et al.  Working memory capacity and its relation to general intelligence , 2003, Trends in Cognitive Sciences.

[21]  Fred Paas,et al.  Assessment of cognitive load in multimedia learning: theory, methods and applications , 2008 .

[22]  M. J. Emerson,et al.  Inner speech as a retrieval aid for task goals: the effects of cue type and articulatory suppression in the random task cuing paradigm. , 2004, Acta psychologica.

[23]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[24]  J. Pickova The Measurement and Appraisal of Adult Intelligence , 1959 .

[25]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[26]  Peter E. Doolittle Multimedia Learning and Working Memory Capacity , 2009 .

[27]  J. G. Quinn,et al.  Interference in Visual Working Memory , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[28]  Katharina Scheiter,et al.  The perceptual basis of the modality effect in multimedia learning. , 2011, Journal of experimental psychology. Applied.

[29]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[30]  Rossana de Beni,et al.  Visuospatial working memory in learning from multimedia systems , 2000, J. Comput. Assist. Learn..

[31]  Tad T. Brunyé,et al.  Learning Procedures: The Role of Working Memory in Multimedia Learning Experiences , 2022 .

[32]  D. J. Murray The role of speech responses in short-term memory. , 1967, Canadian journal of psychology.

[33]  Katharina Scheiter,et al.  Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? , 2009, Comput. Hum. Behav..

[34]  A. Glenberg,et al.  On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies , 1994, Memory & cognition.

[35]  J. Myerson,et al.  The effects of eye and limb movements on working memory , 2001, Memory.

[36]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[37]  D. Pearson,et al.  The Inner Eye and the Inner Scribe of Visuo-spatial Working Memory: Evidence from Developmental Fractionation , 1997 .

[38]  G. McClelland,et al.  Negative Consequences of Dichotomizing Continuous Predictor Variables , 2003 .

[39]  Robert H. Logie,et al.  Mental images in human cognition , 1991 .

[40]  Peter E. Doolittle,et al.  Working Memory Capacity and Mobile Multimedia Learning Environments: Individual Differences in Learning While Mobile , 2008 .

[41]  Peter E. Doolittle,et al.  Multimedia learning and individual differences: Mediating the effects of working memory capacity with segmentation , 2009, Br. J. Educ. Technol..

[42]  Donald A. Norman,et al.  Attention to Action , 1986 .

[43]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[44]  Roland Brünken,et al.  Working Memory Interference During Processing Texts and Pictures: Implications for the Explanation of the Modality Effect , 2010 .

[45]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[46]  Herre van Oostendorp Cognition in a Digital World , 2002 .

[47]  Florian Schmidt-Weigand,et al.  Explaining the modality and contiguity effects: New insights from investigating students' viewing behaviour , 2010 .

[48]  O. Spreen,et al.  Comprar A Compendium of Neuropsychological Tests - Administration, Norms, and Commentary | Esther Strauss | 9780195159578 | Oxford University Press , 2009 .

[49]  G. Schwartz,et al.  Consciousness and Self-Regulation , 1976 .

[50]  R. Engle,et al.  The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning. , 2004, Journal of experimental psychology. General.

[51]  O. Selnes A Compendium of Neuropsychological Tests , 1991, Neurology.

[52]  M. C. Fastame,et al.  Working memory components of the Corsi blocks task. , 2004, British journal of psychology.

[53]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[54]  Alan B. Welsh,et al.  Acoustic masking in primary memory. , 1976 .

[55]  J. Jonides,et al.  Storage and executive processes in the frontal lobes. , 1999, Science.

[56]  V. Gyselinck,et al.  The role of working memory components in multimedia comprehension , 2008 .

[57]  Sarah E. MacPherson,et al.  Concurrent performance of two memory tasks: Evidence for domain-specific working memory systems , 2002, Memory & cognition.

[58]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[59]  Russell N. Carney,et al.  Pictorial Illustrations Still Improve Students' Learning from Text , 2002 .

[60]  J. Wiley,et al.  An examination of the seductive details effect in terms of working memory capacity , 2006, Memory & cognition.

[61]  A. Baddeley Recent developments in working memory , 1998, Current Opinion in Neurobiology.

[62]  Alan D. Baddeley,et al.  Visual patterns test: a test of short-term visual recall , 1997 .

[63]  R. Davidson,et al.  Consciousness and Self-Regulation: Advances in Research and Theory IV , 1976 .

[64]  Katharina Scheiter,et al.  The role of spatial descriptions in learning from multimedia , 2011, Comput. Hum. Behav..

[65]  Roland Brünken,et al.  Memory characteristics and modality in multimedia learning: An aptitude–treatment–interaction study , 2009 .

[66]  B. Milner,et al.  Interhemispheric differences in the localization of psychological processes in man. , 1971, British medical bulletin.

[67]  G. Waters,et al.  The Measurement of Verbal Working Memory Capacity and Its Relation to Reading Comprehension , 1996, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[68]  D. Wechsler The measurement and appraisal of adult intelligence, 4th ed. , 1958 .

[69]  A. Baddeley,et al.  Pattern span: a tool for unwelding visuo–spatial memory , 1999, Neuropsychologia.

[70]  C. Cornoldi,et al.  Role of working memory in explaining the performance of individuals with specific reading comprehension difficulties: A meta-analysis , 2009 .

[71]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[72]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[73]  David G. Pearson The episodic buffer: Implications and connections with visuo-spatial research , 2006 .

[74]  A. Miyake,et al.  Models of Working Memory , 1997 .

[75]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[76]  D. Leutner,et al.  Assessment of cognitive load in multimedia learning using dual-task methodology. , 2002, Experimental psychology.

[77]  A. Miyake,et al.  The separability of working memory resources for spatial thinking and language processing: an individual differences approach. , 1996, Journal of experimental psychology. General.

[78]  R. Mayer,et al.  Multimedia Learning: Frontmatter , 2001 .

[79]  Chiara Meneghetti,et al.  Visuospatial working memory and mental representation of spatial descriptions , 2005 .

[80]  Kristopher J Preacher,et al.  On the practice of dichotomization of quantitative variables. , 2002, Psychological methods.

[81]  J G Quinn,et al.  Irrelevant Pictures in Visual Working Memory , 1996, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[82]  A. Baddeley Working memory and language processing , 1997 .

[83]  M. Rinck,et al.  Multimedia learning: Working memory and the learning of word and picture diagrams , 2006 .

[84]  M. Malbrán The Cambridge Handbook of Multimedia Learning , 2007 .

[85]  Paul Ginns Meta-Analysis of the Modality Effect. , 2005 .

[86]  Connie A. Tompkins,et al.  Reliability and validity of an auditory working memory measure: data from elderly and right-hemisphere damaged adults , 1998 .