Multimedia recipe reading: Predicting learning outcomes and diagnosing cooking interest using eye-tracking measures

This study aimed to explore the relationships between students' visual behaviors and learning outcomes, and between visual behaviors and prior cooking interest in multimedia recipe learning. An eye-tracking experiment, including pretest, recall test, and retention test, was conducted with a sample of 29 volunteer hospitality majors in Taiwan. The multimedia recipe included a static page showing the ingredients in a text-and-picture representation and a dynamic page showing the knife skills in a text-and-video representation. Total reading time, total fixation duration, number of fixations and inter-scanning count were used to explore the students' visual attention distributions among the different representation elements and their visual strategies for learning the recipe. The results showed that all students paid more visual attention to the text than to the picture information for the static recipe, and paid more visual attention to the video than to the text on the dynamic page. In addition, the visual attention paid to the text on the dynamic page was negatively correlated with the retention of the episodic knowledge of knife skills. In contrast, the visual attention paid to the text on the static ingredient page was positively correlated with students' prior cooking interest. Finally, the inter-scanning count between text and video on the dynamic page was the best index to negatively predict students' learning retention. Total fixation duration on the text information on the static page was the best index to positively predict students' prior cooking interest. Future studies and applications are discussed. Retention was negatively predicted by the inter-scanning count between video and text.High retention students show efficient scanning patterns for reading dynamic recipe.Cooking interest was positively diagnosed by the total fixation duration on static text.High interest students paid more visual attention to text for reading static recipe.Text is redundant when video with narration was used in multimedia recipes.

[1]  Tzu-Chien Liu,et al.  Split-attention and redundancy effects on mobile learning in physical environments , 2012, Comput. Educ..

[2]  Wei Wang,et al.  Consumers' interest in learning about cooking: the influence of age, gender and education , 2014 .

[3]  P. Chandler,et al.  THE SPLIT‐ATTENTION EFFECT AS A FACTOR IN THE DESIGN OF INSTRUCTION , 1992 .

[4]  Andreja Bubić,et al.  EYE MOVEMENTS REVEAL STUDENTS’ STRATEGIES IN SIMPLE EQUATION SOLVING , 2014 .

[5]  Paul J. Silvia,et al.  The Resource Replenishment Function of Interest , 2011 .

[6]  Hsin Ning Jessie Ho,et al.  PRIOR KNOWLEDGE AND ONLINE INQUIRY-BASED SCIENCE READING: EVIDENCE FROM EYE TRACKING , 2014 .

[7]  Maria Caterina Tornatora,et al.  An Eye-Tracking Study of Learning From Science Text With Concrete and Abstract Illustrations , 2013 .

[8]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[9]  Katharina Scheiter,et al.  Eye tracking as a tool to study and enhance multimedia learning , 2010 .

[10]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[11]  K. Rayner,et al.  Eye Movements as Reflections of Comprehension Processes in Reading , 2006 .

[12]  Mark Bergland,et al.  Student Performance in a Multimedia Case-Study Environment , 2012, Journal of Science Education and Technology.

[13]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[14]  Fang-Ying Yang,et al.  PROBING THE RELATIONSHIP BETWEEN PROCESS OF SPATIAL PROBLEMS SOLVING AND SCIENCE LEARNING: AN EYE TRACKING APPROACH , 2014 .

[15]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[16]  Yueh-Nu Hung.  “WHAT ARE YOU LOOKING AT?” AN EYE MOVEMENT EXPLORATION IN SCIENCE TEXT READING , 2014 .

[17]  A. Paivio.  Mental Representations: A Dual Coding Approach , 1986 .

[18]  Huei-Tse Hou,et al.  Visual attention for solving multiple-choice science problem: An eye-tracking analysis , 2012, Comput. Educ..

[19]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[20]  F. Paas,et al.  Attention guidance in learning from a complex animation: Seeing is understanding? , 2010 .

[21]  W. Schnotz,et al.  The role of decorative pictures in learning , 2013 .

[22]  Anna Uitto,et al.  INTEREST, ATTITUDES AND SELF-EFFICACY BELIEFS EXPLAINING UPPER-SECONDARY SCHOOL STUDENTS’ ORIENTATION TOWARDS BIOLOGY-RELATED CAREERS , 2014 .

[23]  Meng-Jung Tsai,et al.  A study of cognitive style, visual attention distributions and achievement of Web-based multimedia recipes learning , 2012, CogSci.

[24]  Virginia Clinton,et al.  Interest, Inferences, and Learning from Texts. , 2012 .

[25]  S. Hidi.  Interest, Reading, and Learning: Theoretical and Practical Considerations , 2001 .

[26]  Jodie A. Baird,et al.  Executive Attention and Metacognitive Regulation , 2000, Consciousness and Cognition.

[27]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[28]  Silvia Wen-Yu Lee,et al.  A review of using eye-tracking technology in exploring learning from 2000 to 2012 , 2013 .

[29]  Mary Hegarty,et al.  Effects of knowledge and display design on comprehension of complex graphics , 2010 .

[30]  Jukka Hyönä,et al.  The Use of Eye Movements in the Study of Multimedia Learning. , 2010 .

[31]  Patrik Pluchino,et al.  Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns , 2013, Comput. Educ..

[32]  Florian Schmidt-Weigand,et al.  A closer look at split visual attention in system- and self-paced instruction in multimedia learning , 2010 .

[33]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[34]  M. Wittrock.  Generative Processes of Comprehension , 1989 .

[35]  Yuen-Hsien Tseng,et al.  Tracking learners' visual attention during a multimedia presentation in a real classroom , 2013, Comput. Educ..

[36]  Han-Chin Liu,et al.  An examination of cognitive processing of multimedia information based on viewers' eye movements , 2011, Interact. Learn. Environ..

[37]  Sybil S. Yang.  Eye movements on restaurant menus: a revisitation on gaze motion and consumer scanpaths. , 2012 .

[38]  Wolfgang Schnotz,et al.  Effects of animation's speed of presentation on perceptual processing and learning , 2010 .

[39]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[40]  Hsiao-Ching She,et al.  The impact of multimedia effect on science learning: Evidence from eye movements , 2009, Comput. Educ..

[41]  O. R. Anderson,et al.  Neuroscience Perspectives for Science and Mathematics Learning in Technology-Enhanced Learning Environments , 2014 .