The impact of multimedia effect on science learning: Evidence from eye movements

This study examined how middle school students constructed their understanding of the mitosis and meiosis processes at a molecular level through multimedia learning materials presented in different interaction and sensory modality modes. A two (interaction modes: animation/simulation) by two (sensory modality modes: narration/on-screen text) factorial design was employed. The dependent variables included subjects' pre-test, post-test, and retention-test scores, showing their understanding of mitosis and meiosis process at molecular level, as well as data of subjects' eye-movement behavior. Results showed the group that received animation with narration allocated a greater amount of visual attention (number of fixations, total inspection time, and mean fixation duration) than the group that received animation with on-screen text, in both pictorial area and area of interest, which is consistent with students' immediate and long-term retained learning of the processes of mitosis and meiosis. The group that received simulation with on-screen text allocated a greater amount of visual attention than the group that received simulation with narration, consistent with students' immediate and retained learning. The group that received simulation with on-screen text also allocated a greater amount of visual attention than the group that received animation with on-screen text, consistent with students' immediate and retained learning. This study adds empirical evidence of a direct correlation between the length of eye fixation behavior and the depth of learning. Moreover, it provides insight into the multimedia effect on students' cognitive process through the use of eye fixation behavior evidence.

[1]  R. Mayer.  Systematic Thinking Fostered by Illustrations in Scientific Text , 1989 .

[2]  P. Chandler,et al.  THE SPLIT‐ATTENTION EFFECT AS A FACTOR IN THE DESIGN OF INSTRUCTION , 1992 .

[3]  Robert W. Kentridge,et al.  Eye movement research : mechanisms, processes and applications , 1995 .

[4]  Erol Özçelik,et al.  An eye-tracking study of how color coding affects multimedia learning , 2009, Comput. Educ..

[5]  R. Mayer,et al.  Animation as an Aid to Multimedia Learning , 2002 .

[6]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[7]  Jon Nichol,et al.  Multimedia Simulation: a threat or an enhancement of practical work in science education , 1998 .

[8]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[9]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[10]  M. Hegarty,et al.  Comprehension of Arithmetic Word Problems: Evidence from Students' Eye Fixations. , 1992 .

[11]  G. Loftus.  Eye fixations and recognition memory for pictures , 1972 .

[12]  Jane Butler Kahle,et al.  An Investigation of High School Biology Textbooks as Sources of Misconceptions and Difficulties in Genetics and Some Suggestions for Teaching Genetics. , 1985 .

[13]  R. Mayer,et al.  The instructive animation: helping students build connections between words and pictures in multimedia learning , 1992 .

[14]  C. R. Brown.  Some misconceptions in meiosis shown by students responding to an Advanced level practical examination question in biology , 1990 .

[15]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.

[16]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[17]  Matthew Moore.  In Re Bilski and the “Machine-or-Transformation” Test: Receding Boundaries for Patent Eligible Subject Matter , 2010 .

[18]  Ruth Stavy,et al.  Students' cellular and molecular explanations of genetic phenomena , 2000 .

[19]  Richard E. Mayer,et al.  When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. , 1996 .

[20]  Rauf Yildiz,et al.  The cognitive impact of multimedia simulations on 14 year old students , 1996, Br. J. Educ. Technol..

[21]  Alex H. Johnstone,et al.  Isolating topics of high perceived difficulty school biology , 1980 .

[22]  George M. Malacinski,et al.  Manipulating the "Invisible": Learning Molecular Biology Using Inexpensive Models. , 1996 .

[23]  Michael Bassey,et al.  Practical Work in School Science , 1963 .

[24]  R. Mayer,et al.  Multimedia learning: Are we asking the right questions? , 1997 .

[25]  J. Hyönä,et al.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children. , 1999, Contemporary educational psychology.

[26]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[27]  Alan Radford,et al.  Teaching Genetics in Schools. , 1982 .

[28]  David F. Treagust,et al.  Research data necessary for meaningful review of grade ten high school genetics curricula , 1984 .

[29]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[30]  Geoffrey Underwood,et al.  Inspecting Pictures for Information to Verify a Sentence: Eye Movements in General Encoding and in Focused Search , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[31]  M. Just,et al.  The role of eye-fixation research in cognitive psychology , 1976 .

[32]  Richard E. Clark,et al.  Transfer of training principles for instructional design , 1985 .

[33]  Joseph D. Novak,et al.  Misconceptions in Science and Mathematics. Proceedings of the International Seminar. (Cornell University, Ithaca, NY, USA, June 20-22, 1983). , 1983 .

[34]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[35]  A. L. Yarbus.  Eye Movements During Perception of Complex Objects , 1967 .

[36]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[37]  Geoffrey R. Loftus,et al.  Eye fixations and memory for emotional events. , 1991 .

[38]  Jenny M. Lewis,et al.  Genes, chromosomes, cell division and inheritance - do students see any relationship? , 2000 .

[39]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[40]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[41]  M. Hegarty.  Mental animation: inferring motion from static displays of mechanical systems. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[42]  Joan K. Gallini,et al.  When Is an Illustration Worth Ten Thousand Words , 1990 .

[43]  Bernard Longden.  Genetics - Are There Inherent Learning Difficulties?. , 1982 .

[44]  John J. Koran,et al.  Interaction of learner characteristics with pictorial adjuncts in learning from science text , 1980 .

[45]  Patricia L. Linn.  Theories About Learning and Development in Cooperative , 2003 .

[46]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[47]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[48]  T. Foulsham,et al.  Is attention necessary for object identification? Evidence from eye movements during the inspection of real-world scenes , 2008, Consciousness and Cognition.

[49]  J. Boyle.  A Manifesto on WIPO and the Future of Intellectual Property , 2004 .

[50]  K. Rayner.  Eye Movements and Cognitive Processes in Reading, Visual Search, and Scene Perception , 1995 .

[51]  Jacob Cohen.  Measurement Educational and Psychological Educational and Psychological Measurement Eta-squared and Partial Eta-squared in Fixed Factor Anova Designs Educational and Psychological Measurement Additional Services and Information For , 2022 .

[52]  Avi Parush,et al.  Learning histories in simulation-based teaching: the effects on self-learning and transfer , 2002, Comput. Educ..

[53]  K. Rayner,et al.  Contextual effects on word perception and eye movements during reading , 1981 .

[54]  B. Thompson.  Foundations of behavioral statistics : an insight-based approach , 2006 .

[55]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[56]  H. Tabbers,et al.  Multimedia instructions and cognitive load theory: effects of modality and cueing. , 2004, The British journal of educational psychology.

[57]  David E. Kieras,et al.  New methods in reading comprehension research , 1986 .

[58]  J. T. Pearson,et al.  Problems with the use of terminology in genetics education: 1, A literature review and classification scheme , 1988 .

[59]  B. Thompson,et al.  How to Estimate and Interpret Various Effect Sizes , 2004 .

[60]  P. Carroll,et al.  Visual Analysis of Cartoons: A View from the Far Side , 1992 .