Modeling Reading Behaviors: An Automatic Approach to Eye Movement Analytics

Critical reading plays an important role in science learning, and previous studies have endeavored to objectively and precisely capture readers’ cognitive processing in reading scientific texts. Since many factors affect readers’ initiation and comprehension of scientific texts, studying the interactions of these factors was technically challenging for earlier studies. Recently, the use of artificial intelligent techniques for analyzing physiological signals has gained significant research attention, but exploitation of the educational data for proactive instructional use is still limited. This study proposed and evaluated an automatic approach incorporating the K-means++ clustering method for eye movement analytics. In this study, 64 undergraduate and graduate students read a multi-page popular science text while their eye movements were recorded. The results of the cluster analysis identified three patterns of reading behavior that were consistent and comparable to those of previous studies using self-reported measures and post-analysis analytics. Findings of the study support the potential and validity of a bottom-up, data-driven approach that can directly examine and analyze reading behaviors without interruption, and the contribution of the study to research and practice is outlined.

[1]  Xin Chen,et al.  Temporal predication of dropouts in MOOCs: Reaching the low hanging fruit through stacking generalization , 2016, Comput. Hum. Behav..

[2]  Glenda C. Rakes.  Using Visuals to Enhance Secondary Students' Reading Comprehension of Expository Texts. , 1995 .

[3]  J. Hyönä,et al.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children. , 1999, Contemporary educational psychology.

[4]  Trupti M. Kodinariya,et al.  Review on determining number of Cluster in K-Means Clustering , 2013 .

[5]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[6]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[7]  Tim N. Höffler,et al.  The Influence of Visual Cognitive Style when Learning from Instructional Animations and Static Pictures. , 2010 .

[8]  Ryan S. Baker,et al.  Educational Data Mining and Learning Analytics , 2014 .

[9]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[10]  P. Broek,et al.  The effects of prior knowledge and text structure on comprehension processes during reading of scientific texts , 2007, Memory & cognition.

[11]  Richard E. Mayer,et al.  An eye movement analysis of highlighting and graphic organizer study aids for learning from expository text , 2014, Comput. Hum. Behav..

[12]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[13]  Aidan Kehoe,et al.  Using eye tracking technology to identify visual and verbal learners , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[14]  Li-Chen Fu,et al.  Reading with robot and human companions in library literacy activities: A comparison study , 2020, Br. J. Educ. Technol..

[15]  P. Kirschner,et al.  Do Learners Really Know Best? Urban Legends in Education , 2013 .

[16]  Jue Qu,et al.  Research on Human-Computer Interaction Intention Recognition Based on EEG and Eye Movement , 2020, IEEE Access.

[17]  Md. Rafiqul Islam Sheikh,et al.  A Visual Analytic in Deep Learning Approach to Eye Movement for Human-Machine Interaction Based on Inertia Measurement , 2020, IEEE Access.

[18]  R. Mayer.  Educational Psychology: A Cognitive Approach , 1987 .

[19]  A. Graesser,et al.  Toward a Functional Analysis of Scientific Genres: Implications for Understanding and Learning Processes , 2014 .

[20]  Rebecca R. Norman,et al.  Reading the graphics: what is the relationship between graphical reading processes and student comprehension? , 2012 .

[21]  Andrew T. Duchowski,et al.  Gaze Transition Entropy , 2015, TAP.

[22]  Patricia A. Alexander,et al.  Learning and study strategies : issues in assessment, instruction, and evaluation , 1988 .

[23]  David Moore,et al.  Learning Style Theory and Computer Mediated Communication , 2001 .

[24]  Pablo Rojas Castro,et al.  Learning Analytics. From Research to Practice , 2016 .

[25]  Hui-Yu Yang.  The effects of visuospatial cueing on EFL learners' science text and picture processing through mobile phones , 2019, Technology in Society.

[26]  Patrik Pluchino,et al.  Integrative processing of verbal and graphical information during re-reading predicts learning from illustrated text: an eye-movement study , 2015 .

[27]  Alexander J. Casson,et al.  Applying Machine Learning to Kinematic and Eye Movement Features of a Movement Imitation Task to Predict Autism Diagnosis , 2020, Scientific Reports.

[28]  Agostino Gibaldi,et al.  Evaluation of the Tobii EyeX Eye tracking controller and Matlab toolkit for research , 2016, Behavior Research Methods.

[29]  Maartje E. J. Raijmakers,et al.  Cognitive strategies revealed by clustering eye movement transitions , 2020, Journal of eye movement research.

[30]  Diego Reforgiato Recupero,et al.  Bridging learning analytics and Cognitive Computing for Big Data classification in micro-learning video collections , 2019, Comput. Hum. Behav..

[31]  Masayuki Murakami,et al.  How Learners with Different Cognitive Styles Read Learning Materials with Text and Pictures: A Gaze Analysis , 2019, HCI.

[32]  Yu-Cin Jian.  Eye-movement patterns and reader characteristics of students with good and poor performance when reading scientific text with diagrams , 2017 .

[33]  Patrik Pluchino,et al.  Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns , 2013, Comput. Educ..

[34]  Patrik Pluchino,et al.  Using eye-tracking technology as an indirect instruction tool to improve text and picture processing and learning , 2016, Br. J. Educ. Technol..

[35]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[36]  Hiroaki Ogata,et al.  Applying Learning Analytics for the Early Prediction of Students' Academic Performance in Blended Learning , 2018, J. Educ. Technol. Soc..

[37]  R. Mayer,et al.  Three Facets of Visual and Verbal Learners: Cognitive Ability, Cognitive Style, and Learning Preference. , 2003 .

[38]  Silvia Wen-Yu Lee,et al.  A review of using eye-tracking technology in exploring learning from 2000 to 2012 , 2013 .

[39]  Detlev Leutner,et al.  Visualizers versus verbalizers : Effects of cognitive style on learning with texts and pictures e An eye-tracking study , 2016 .

[40]  Terry L. Childers,et al.  Measurement of Individual Differences in Visual Versus Verbal Information Processing , 1985 .