Evaluating multimedia learning materials in primary education using eye tracking

Abstract The development of multimedia educational materials aimed at primary school students is of great importance today. The design, mainly of images and text, can influence the efficiency of these materials in the teaching-learning process. One of the most widespread theories that deals with the correct design of multimedia materials is the Mayer's Cognitive Theory of multimedia learning. In this research work we are interested in validating some of the principles enunciated by this theory in materials aimed at primary school students (children aged seven and eleven) and in the field of geometry teaching. For this purpose, we performed four experiments using the eye tracking technique in the data collection process. Using eye tracking, we can analyze how the process of the visual observation of multimedia contents is produced. The main contribution of this study is the proposal for the use of this evaluation method, which allows us to validate empirically and objectively (physiologically) aspects such as the comprehension process of multimedia content, the attention of the students while analyzing the information provided or the cognitive load of the supplied materials. Faced with questionnaires or surveys, which have been used traditionally to analyze the efficiency of multimedia materials and have a more subjective nature, eye tracking provides information not consciously controlled by the students. Its use is a particularly interesting and useful source of information in the case of children, allowing us to collect information on their interests and preferences, which is more difficult to obtain using traditional techniques.

[1]  R. Moreno,et al.  Do Multiple Representations Need Explanations? The Role of Verbal Guidance and Individual Differences in Multimedia Mathematics Learning , 2004 .

[2]  O. R. Anderson,et al.  Neuroscience Perspectives for Science and Mathematics Learning in Technology-Enhanced Learning Environments , 2014 .

[3]  Richard E. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[4]  Halimah Badioze Zaman,et al.  Different Visualization Types in Multimedia Learning: A Comparative Study , 2011, IVIC.

[5]  Ornella Robutti,et al.  How students read mathematical representations: An eye tracking study , 2009 .

[6]  Dorit Patkin,et al.  Various Ways of Inculcating New Solid Geometry Concepts. , 2015 .

[7]  Marina Milovanovic,et al.  APPLICATION OF INTERACTIVE MULTIMEDIA TOOLS IN TEACHING MATHEMATICS - EXAMPLES OF LESSONS FROM GEOMETRY , 2013 .

[8]  Frederick J. Brigham,et al.  An exploration of the use of eye‐gaze tracking to study problem‐solving on standardized science assessments , 2006 .

[9]  Hsiao-Ching She,et al.  The impact of multimedia effect on science learning: Evidence from eye movements , 2009, Comput. Educ..

[10]  Katharina Scheiter,et al.  Eye tracking as a tool to study and enhance multimedia learning , 2010 .

[11]  Yuen-Hsien Tseng,et al.  Tracking learners' visual attention during a multimedia presentation in a real classroom , 2013, Comput. Educ..

[12]  Sarah Norgate,et al.  How revealing are eye-movements for understanding web engagement in young children , 2011, CHI Extended Abstracts.

[13]  Aga Bojko,et al.  Eye Tracking the User Experience: A Practical Guide to Research , 2013 .

[14]  Sang Ha Lee,et al.  A Psychometric Study of the Index of Learning Styles© , 2007 .

[15]  Rina Hershkowitz,et al.  Visualization in Geometry--Two Sides of the Coin. , 1989 .

[16]  Patricia S. Moyer-Packenham,et al.  Effects of Virtual Manipulatives on Student Achievement and Mathematics Learning , 2013, Int. J. Virtual Pers. Learn. Environ..

[17]  David Sheffield,et al.  Exploring the Relationship Between Mathematics Anxiety and Performance: An Eye‐Tracking Approach , 2015 .

[18]  Andreja Bubić,et al.  EYE MOVEMENTS REVEAL STUDENTS’ STRATEGIES IN SIMPLE EQUATION SOLVING , 2014 .

[19]  H. Ritter,et al.  Processing and Integrating Multimodal Material — The Influence of Color-Coding , 2005 .

[20]  Abraham Arcavi,et al.  The role of visual representations in the learning of mathematics , 2003 .

[21]  Colette Laborde,et al.  The Hidden Role of Diagrams in Students’ Construction of Meaning in Geometry , 2005 .

[22]  Orit Zaslavsky,et al.  Is a visual example in geometry always helpful , 2007 .

[23]  Jason Dunn,et al.  Using Technology in Education When and Why, Not How , 1996 .

[24]  Chih-Hung Lin,et al.  The learning benefits of using eye trackers to enhance the geospatial abilities of elementary school students , 2014, Br. J. Educ. Technol..

[25]  Magdalena Andrzejewska,et al.  The eye-tracking research method in the process of solving mathematical tasks requiring drawing analysis , 2014 .

[26]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[27]  John J. H. Lin,et al.  Tracking eye movements when solving geometry problems with handwriting devices , 2014 .

[28]  Phil Vahey,et al.  Cornerstone Mathematics: designing digital technology for teacher adaptation and scaling , 2013 .

[29]  Emilio Letón,et al.  Use of animated text to improve the learning of basic mathematics , 2015, Comput. Educ..

[30]  Claudia M. Roebers,et al.  The Role of Executive Control of Attention and Selective Encoding for Preschoolers' Learning , 2012 .

[31]  David C. Banks,et al.  Analysis of eye-tracking experiments performed on a Tobii T60 , 2008, Electronic Imaging.

[32]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[33]  Jason L. Anthony,et al.  Improving Mathematics Learning of Kindergarten Students Through Computer-Assisted Instruction , 2016 .

[34]  Izzat Alsmadi,et al.  Studying the Impact of Using Multimedia Interactive Programs on Children's Ability to Learn Basic Math Skills , 2013 .

[35]  Ornella Robutti,et al.  READING MATHEMATICS REPRESENTATIONS: AN EYE-TRACKING STUDY , 2015 .

[36]  Richard E. Mayer,et al.  Unique Contributions of Eye-Tracking Research to the Study of Learning with Graphics , 2010 .

[37]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[38]  Fred Paas,et al.  Effects of Computer-Based Visual Representation on Mathematics Learning and Cognitive Load , 2015, J. Educ. Technol. Soc..

[39]  Roland Brünken,et al.  Cognitive Load Theory: THEORY , 2010 .

[40]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[41]  Lieven Verschaffel,et al.  A validation of eye movements as a measure of elementary school children's developing number sense , 2008 .

[42]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[43]  Tzu-Chien Liu,et al.  Split-attention and redundancy effects on mobile learning in physical environments , 2012, Comput. Educ..

[44]  Đurđica Takači,et al.  Multimedia Approach in Teaching Mathematics – Examples of Interactive Lessons from Mathematical Analysis and Geometry , 2012 .

[45]  Eric N. Wiebe,et al.  Eye-Tracking Students' Attention to PowerPoint Photographs in a Science Education Setting , 2005 .

[46]  Patrick Barmby,et al.  How young children view mathematical representations: a study using eye-tracking technology , 2015 .

[47]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[48]  Rohani Ahmad Tarmizi,et al.  Understanding Primary School teachers' perspectives of teaching and learning in geometry: Shapes and Spaces , 2015, 2015 International Conference on Research and Education in Mathematics (ICREM7).

[49]  Andreas Floros,et al.  Bringing Digital Multimedia in Mathematics Education , 2008 .

[50]  Robert K. Atkinson,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning of Mathematics , 2005 .

[51]  Jean Saint-Aubin,et al.  What Children Are Looking at During Shared Storybook Reading , 2005, Psychological science.

[52]  Qing Li,et al.  A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning , 2010 .

[53]  J. Hyönä,et al.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children. , 1999, Contemporary educational psychology.

[54]  Yao-Ting Sung,et al.  Developing geometry thinking through multimedia learning activities , 2007, Comput. Hum. Behav..

[55]  R. Mayer,et al.  Does the modality principle for multimedia learning apply to science classrooms , 2007 .

[56]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[57]  Daniel Churchill,et al.  Exploring the characteristics of an optimal design of digital materials for concept learning in mathematics: Multimedia learning and variation theory , 2015, Comput. Educ..

[58]  Andrew T. Duchowski,et al.  Multimodal learning with audio description: an eye tracking study of children's gaze during a visual recognition task , 2012, SAP.

[59]  Andreas Obersteiner,et al.  Measuring fraction comparison strategies with eye-tracking , 2016 .

[60]  Mike Rinck,et al.  Chapter 16 – Eye Movement Measures to Study Global Text Processing , 2003 .

[61]  M. Battista Learning Geometry in a Dynamic Computer Environment. , 2002 .

[62]  Erol Özçelik,et al.  An eye-tracking study of how color coding affects multimedia learning , 2009, Comput. Educ..

[63]  Tong Pang,et al.  Research on the Applications of Multimedia Technique in the Mathematical Teaching and Education , 2015 .

[64]  Daniel Ansari,et al.  Cognitive neuroscience and mathematics learning: how far have we come? Where do we need to go? , 2016 .

[65]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[66]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[67]  Eric Jamet,et al.  An eye-tracking study of cueing effects in multimedia learning , 2014, Comput. Hum. Behav..

[68]  Han-Chin Liu,et al.  Using eye-tracking technology to investigate the redundant effect of multimedia web pages on viewers' cognitive processes , 2011, Comput. Hum. Behav..

[69]  Nwaocha Vivian Ogochukwu Enhancing students interest in mathematics via multimedia presentation , 2010 .

[70]  John J. H. Lin,et al.  COGNITIVE LOAD FOR CONFIGURATION COMPREHENSION IN COMPUTER-SUPPORTED GEOMETRY PROBLEM SOLVING: AN EYE MOVEMENT PERSPECTIVE , 2013, International Journal of Science and Mathematics Education.

[71]  San José,et al.  UTILIZACIÓN DE EYE TRACKING PARA EVALUAR EL USO DE INFORMACIÓN VERBAL EN MATERIALES MULTIMEDIA USING EYE TRACKING TECHNIQUES TO EVALUATE THE USE OF VERBAL INFORMATION IN MULTIMEDIA MATERIALS , 2016 .

[72]  Jukka Hyönä,et al.  The Use of Eye Movements in the Study of Multimedia Learning. , 2010 .

[73]  Raymond Duval A Cognitive Analysis of Problems of Comprehension in a Learning of Mathematics , 2006 .

[74]  A. Bishop Review of Research on Visualization in Mathematics Education. , 1989 .

[75]  Patrik Pluchino,et al.  Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns , 2013, Comput. Educ..

[76]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[77]  Ken Kelley,et al.  An eye for relations: eye-tracking indicates long-term negative effects of operational thinking on understanding of math equivalence , 2013, Memory & cognition.

[78]  Djurdjica Takači,et al.  The influence of computer on examining trigonometric functions , 2008 .

[79]  Hsueh-Chih Chen,et al.  Eye tracking technology for learning and education , 2010 .

[80]  Michal Yerushalmy,et al.  Functions of Interactive Visual Representations in Interactive Mathematical Textbooks , 2005, Int. J. Comput. Math. Learn..

[81]  Christof Körner,et al.  Eye movements reflect and shape strategies in fraction comparison , 2015, Quarterly journal of experimental psychology.

[82]  Huei-Tse Hou,et al.  Visual attention for solving multiple-choice science problem: An eye-tracking analysis , 2012, Comput. Educ..

[83]  R. Grabner,et al.  Potential applications of cognitive neuroscience to mathematics education , 2016 .

[84]  Andrew T. Duchowski,et al.  Audio description as an aural guide of children's visual attention: evidence from an eye-tracking study , 2012, ETRA.