Why does signaling enhance multimedia learning? Evidence from eye movements

Previous studies have suggested that signaling enhances multimedia learning. However, there is not enough evidence showing why signaling leads to better performance. The goal of this study was to examine the effects of signaling on learning outcomes and to reveal the underlying reasons for this effect by using eye movement measures. The participants were 40 undergraduate students who were presented with either signaled or nonsignaled multimedia materials. Labels in the illustration were signaled by temporarily changing the color of the items. The results suggest that the signaled group outperformed the nonsignaled group on transfer and matching tests. Eye movement data shows that signaling guided attention to relevant information and improved the efficiency and effectiveness of finding necessary information.

[1]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[2]  T. Gog,et al.  Uncovering Expertise-Related Differences in Troubleshooting Performance: Combining Eye Movement and Concurrent Verbal Protocol Data , 2005 .

[3]  Richard K. Lowe,et al.  An Eye Tracking Comparison of External Pointing Cues and Internal Continuous Cues in Learning with Complex Animations , 2010 .

[4]  Richard E. Mayer,et al.  Unique Contributions of Eye-Tracking Research to the Study of Learning with Graphics , 2010 .

[5]  F. Paas,et al.  Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design , 2009 .

[6]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[7]  J. Hyönä,et al.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children. , 1999, Contemporary educational psychology.

[8]  A. Yonelinas.  The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[9]  John P. Rickards,et al.  Signaling, notetaking, and field independence–dependence in text comprehension and recall. , 1997 .

[10]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[11]  P. Chandler,et al.  The Role of Visual Indicators in Dual Sensory Mode Instruction , 1997 .

[12]  R. Mayer,et al.  Does the modality principle for multimedia learning apply to science classrooms , 2007 .

[13]  J. Henderson.  Regarding Scenes , 2007 .

[14]  Robert F. Lorch,et al.  Effects of Headings on Text Processing Strategies. , 2001, Contemporary educational psychology.

[15]  Scotty D. Craig,et al.  Animated Pedagogical Agents in Multimedia Educational Environments: Effects of Agent Properties, Picture Features, and Redundancy , 2002 .

[16]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[17]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[18]  F. Paas,et al.  Attention Cueing as a Means to Enhance Learning from an Animation , 2007 .

[19]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[20]  Eric Jamet,et al.  Attention guiding in multimedia learning , 2008 .

[21]  Richard E. Mayer,et al.  Signaling as a Cognitive Guide in Multimedia Learning , 2001 .

[22]  H. Tabbers,et al.  Multimedia instructions and cognitive load theory: effects of modality and cueing. , 2004, The British journal of educational psychology.

[23]  Robert F. Lorch,et al.  Effects of organizational signals on text-processing strategies. , 1995 .

[24]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[25]  Richard Lowe,et al.  Interrogation of a dynamic visualization during learning , 2004 .

[26]  K. Tobin.  The Role of Wait Time in Higher Cognitive Level Learning , 1987 .

[27]  Erol Özçelik,et al.  An eye-tracking study of how color coding affects multimedia learning , 2009, Comput. Educ..

[28]  R. Mayer,et al.  Aids to computer-based multimedia learning , 2002 .

[29]  Bonnie J. F. Meyer,et al.  Effects of Structure Strategy Training and Signaling on Recall of Text. , 2001 .

[30]  John Sweller,et al.  Cognitive Load Theory and the Use of Educational Technology. , 2008 .

[31]  Linda K. Cook,et al.  Techniques that Help Readers Build Mental Models from Scientific Text: Definitions Pretraining and Signaling. , 1984 .

[32]  Nancy Lockitch Loman,et al.  SIGNALING TECHNIQUES THAT INCREASE THE UNDERSTANDABILITY OF EXPOSITORY PROSE , 1983 .

[33]  K. Rayner.  Eye movements in reading and information processing. , 1978, Psychological bulletin.

[34]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[35]  R. F. Lorch,et al.  Effects of Typographical Cues on Reading and Recall of Text , 1995 .

[36]  Jukka Hyönä,et al.  The Use of Eye Movements in the Study of Multimedia Learning. , 2010 .

[37]  Belita Gordon,et al.  Using Rating Augmentation to Expand the Scale of an Analytic Rubric , 2000 .

[38]  R. F. Lorch,et al.  Text-signaling devices and their effects on reading and memory processes , 1989 .

[39]  F. Paas,et al.  Attention guidance in learning from a complex animation: Seeing is understanding? , 2010 .

[40]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[41]  J. D. Fletcher,et al.  The Multimedia Principle. , 2005 .

[42]  Fred Paas,et al.  Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction , 2009, Comput. Hum. Behav..

[43]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[44]  Arthur C. Graesser,et al.  Question asking and eye tracking during cognitive disequilibrium: Comprehending illustrated texts on devices when the devices break down , 2005, Memory & cognition.

[45]  D. Leutner,et al.  Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects , 2004 .

[46]  Paul Ginns.  Meta-Analysis of the Modality Effect. , 2005 .

[47]  John Sweller,et al.  Efficiency in Learning: Evidence-Based Guidelines to Manage Cognitive Load , 2005 .

[48]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[49]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[50]  Mary Hegarty,et al.  Top-down and bottom-up influences on learning from animations , 2007, Int. J. Hum. Comput. Stud..

[51]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[52]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[53]  Geoffrey Underwood,et al.  Inspecting Pictures for Information to Verify a Sentence: Eye Movements in General Encoding and in Focused Search , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[54]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[55]  T. Gog,et al.  Effects of prior knowledge and concept-map structure on disorientation, cognitive load, and learning , 2009 .

[56]  Shawn M. Glynn,et al.  Control of Prose Processing via Instructional and Typographical Cues. , 1979 .

[57]  John R. Anderson,et al.  Eye Movements Do Not Reflect Retrieval Processes , 2004, Psychological science.

[58]  Michael J. Spivey,et al.  Eye Movements and Problem Solving , 2003, Psychological science.