The modality effect tested in children in a user-paced multimedia environment

The modality learning effect proposes that learning is enhanced when information is presented in both the visual and the auditory domains (e.g. pictures and spoken information) compared with presenting information solely in the visual channel (e.g. pictures and written text). Most of the evidence for this effect comes from adults in a laboratory setting. Therefore, we tested the modality effect with 80 children in the highest grade of elementary school in a naturalistic setting. In a between-subjects design, the children either saw representational pictures with speech or representational pictures with text. Retention and transfer knowledge was tested at three moments: immediately after the intervention, one day after and after one week. The present study did not find any evidence for a modality effect in children when the lesson was learner-paced. Instead, we found a reversed modality effect directly after the intervention for retention. A reversed modality effect was also found for the transfer questions one day later. This effect was robust, even when controlling for individual differences.

[1]  Catherine G. Penney,et al.  Modality effects in short-term verbal memory. , 1975 .

[2]  Mary Hegarty,et al.  Revising the Visualizer-Verbalizer Dimension: Evidence for Two Types of Visualizers , 2002 .

[3]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[4]  John Sweller,et al.  Cognitive Load Theory: Instructional Implications of the Interaction between Information Structures and Cognitive Architecture , 2004 .

[5]  R. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[6]  C. Perfetti,et al.  Differences between written and spoken input in learning new words , 2005 .

[7]  Richard E. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[8]  Jochen Müsseler,et al.  Recalling oral and written discourse. , 1987 .

[9]  Eliane Segers,et al.  Cognitive processes in children's multimedia text learning , 2008 .

[10]  P. Chandler,et al.  The Role of Visual Indicators in Dual Sensory Mode Instruction , 1997 .

[11]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[12]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[13]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[14]  Bruce L. Mann,et al.  A comparison of temporal speech and text cueing in educational multimedia , 2002, J. Comput. Assist. Learn..

[15]  Eric N. Wiebe,et al.  Eye-Tracking Students' Attention to PowerPoint Photographs in a Science Education Setting , 2005 .

[16]  Bruce L. Mann,et al.  The evolution of multimedia sound , 2008, Comput. Educ..

[17]  F. R. Yekovich,et al.  The effect of modality on long-term recognition memory , 1988 .

[18]  D. Wechsler Wechsler Intelligence Scale for Children , 2020, Definitions.

[19]  H. Tabbers,et al.  Multimedia instructions and cognitive load theory: effects of modality and cueing. , 2004, The British journal of educational psychology.

[20]  K. Stanovich Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. , 1986 .

[21]  J. Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Modality Principle in Multimedia Learning , 2005 .

[22]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[23]  R. Mayer,et al.  Multimedia learning: Are we asking the right questions? , 1997 .

[24]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[25]  R. Mayer,et al.  Three Facets of Visual and Verbal Learners: Cognitive Ability, Cognitive Style, and Learning Preference. , 2003 .

[26]  A. Baddeley,et al.  The phonological loop as a language learning device. , 1998, Psychological review.

[27]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[28]  Paul Ginns Meta-Analysis of the Modality Effect. , 2005 .