Memory characteristics and modality in multimedia learning: An aptitude–treatment–interaction study

Abstract According to the modality effect in multimedia, a text accompanying a picture should be auditorily presented instead of visually in order to avoid split of attention. In two experimental studies (34 and 78 participants, respectively), the impact and possible compensatory effects of two aptitude variables, that is, memory strategy skills and working memory capacity, on multimedia learning were tested. Aptitude–treatment–interaction effects were found with respect to comprehension (Study 1) and transfer (Study 2). The modality effect was confirmed for less-skilled learners in memory strategy use but not for highly skilled ones. Memory strategy skills and working memory capacity differentially affected multimedia learning, depending on task features and demands.

[1]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[2]  Slava Kalyuga.  The Cambridge Handbook of Multimedia Learning: Prior Knowledge Principle in Multimedia Learning , 2005 .

[3]  Tina Seufert,et al.  Cognitive load and the format of instructional aids for coherence formation , 2006 .

[4]  Perry D. Klein,et al.  The Role of Writing in Learning from Analogies. , 2007 .

[5]  Tina Seufert.  Supporting Coherence Formation in Learning from Multiple Representations , 2003 .

[6]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[7]  K. A. Ericsson,et al.  Long-Term Working Memory as an Alternative to Capacity Models of Working Memory in Everyday Skilled Performance , 1999 .

[8]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[9]  P. Chandler,et al.  When auditory presentations should and should not be a component of multimedia instruction , 2003 .

[10]  C. Penney.  Modality effects and the structure of short-term verbal memory , 1989, Memory & cognition.

[11]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[12]  H. Tabbers,et al.  The modality of text in multimedia instructions:Refining the design guidelines. , 2002 .

[13]  John Sweller,et al.  The Redundancy Principle in Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[14]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[15]  Paul Ginns.  Meta-Analysis of the Modality Effect. , 2005 .

[16]  J. Sweller,et al.  Cognitive load effects in a primary-school geometry task , 1993 .

[17]  R. Sternberg,et al.  Learning and individual differences: Advances in theory and research. , 1989 .

[18]  R. Snow,et al.  Lecture 2: Toward a Theory of Cognitive Aptitude for Learning from Instruction , 1984 .

[19]  Slava Kalyuga,et al.  Incorporating Learner Experience into the Design of Multimedia Instruction. , 2000 .

[20]  A. Miyake,et al.  Models of Working Memory , 1997 .

[21]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[22]  L. Thurstone.  Primary mental abilities. , 1938, Science.

[23]  Min-ju Lu,et al.  Effects of skill training on working memory capacity , 2007 .

[24]  R. Snow.  Aptitude-treatment interaction as a framework for research on individual differences in learning. , 1989 .

[25]  O. Wilhelm,et al.  Working memory capacity - facets of a cognitive ability construct , 2000 .

[26]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[27]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[28]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[29]  R. Mayer,et al.  Does the modality principle for multimedia learning apply to science classrooms , 2007 .

[30]  Alexander Renkl,et al.  Finding and fixing errors in worked examples: Can this foster learning outcomes? ☆ , 2007 .

[31]  J. Sweller.  Evolution of human cognitive architecture , 2003 .

[32]  Sharon K Tindall-Ford,et al.  When two sensory modes are better than one , 1997 .

[33]  S. West,et al.  Multiple Regression: Testing and Interpreting Interactions. , 1994 .

[34]  D. McNamara,et al.  Working memory capacity and strategy use , 2001, Memory & cognition.

[35]  Slava Kalyuga.  Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction , 2007 .

[36]  Robert J. Sternberg,et al.  Mind in context : interactionist perspectives on human intelligence , 1994 .

[37]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[38]  A. Baddeley.  Is working memory still working , 2001 .

[39]  J. Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Modality Principle in Multimedia Learning , 2005 .

[40]  Fred Paas,et al.  Effects of studying sequences of process-oriented and product-oriented worked examples on troubleshooting transfer efficiency , 2008 .

[41]  J. Sweller.  Implications of Cognitive Load Theory for Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[42]  R. Mayer,et al.  Learning Science in Virtual Reality Multimedia Environments: Role of Methods and Media , 2002 .

[43]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.