Using support vector machines to identify literacy skills: Evidence from eye movements

Is inferring readers’ literacy skills possible by analyzing their eye movements during text reading? This study used Support Vector Machines (SVM) to analyze eye movement data from 61 undergraduate students who read a multiple-paragraph, multiple-topic expository text. Forward fixation time, first-pass rereading time, second-pass fixation time, and regression path reading time on different regions of the text were provided as features. The SVM classification algorithm assisted in distinguishing high-literacy-skilled readers from low-literacy-skilled readers with 80.3 % accuracy. Results demonstrate the effectiveness of combining eye tracking and machine learning techniques to detect readers with low literacy skills, and suggest that such approaches can be potentially used in predicting other cognitive abilities.

[1]  Keith Rayner,et al.  Don’t Believe What You Read (Only Once) , 2014, Psychological science.

[2]  Mehmet Fatih Akay,et al.  Support vector machines combined with feature selection for breast cancer diagnosis , 2009, Expert Syst. Appl..

[3]  Raymond Bertram,et al.  The Effect of Expertise on Eye Movement Behaviour in Medical Image Perception , 2013, PloS one.

[4]  Keith Rayner,et al.  Eye movements, the perceptual span, and reading speed , 2010, Psychonomic bulletin & review.

[5]  Keith E. Stanovich,et al.  Cognitive variation in adult college students differing in reading ability. , 1990 .

[6]  R. Kliegl,et al.  Adult age differences in the perceptual span during reading. , 2011, Psychology and aging.

[7]  Donald Shankweiler,et al.  Reading and spelling difficulties in high school students: Causes and consequences , 1996 .

[8]  Carrick C. Williams,et al.  Eye movements during information processing tasks: Individual differences and cultural effects , 2007, Vision Research.

[9]  Sally Andrews,et al.  Lexical Quality and Eye Movements: Individual Differences in the Perceptual Span of Skilled Adult Readers , 2014, Quarterly journal of experimental psychology.

[10]  Kurt Hornik,et al.  Support Vector Machines in R , 2006 .

[11]  Kristin P. Bennett,et al.  Support vector machines: hype or hallelujah? , 2000, SKDD.

[12]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[13]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics (e1071), TU Wien , 2014 .

[14]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[15]  D. Coppola,et al.  Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments , 1999, Vision Research.

[16]  Albrecht W Inhoff,et al.  Word integration and regression programming during reading: a test of the E-Z reader 10 model. , 2009, Journal of experimental psychology. Human perception and performance.

[17]  Lorenzo Bruzzone,et al.  A technique for feature selection in multiclass problems , 2000 .

[18]  Keith Rayner,et al.  Eye Movements of Highly Skilled and Average Readers: Differential Effects of Frequency and Predictability , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[19]  K Rayner,et al.  The role of phonology in the activation of word meanings during reading: evidence from proofreading and eye movements. , 1999, Journal of experimental psychology. General.

[20]  L. Durieux,et al.  Identifying optimal classification rules for geographic object-based image analysis , 2013 .

[21]  M. Schoot,et al.  Lexical ambiguity resolution in good and poor comprehenders: An eye fixation and self-paced reading study in primary school children , 2009 .

[22]  Erik D. Reichle,et al.  Using E-Z Reader to examine the concurrent development of eye-movement control and reading skill. , 2013, Developmental review : DR.

[23]  Bonnie J. F. Meyer,et al.  Structure Strategy Interventions: Increasing Reading Comprehension of Expository Text. , 2011 .

[24]  Erik D. Reichle,et al.  E-Z Reader : An Overview of the Model and Two Recent Applications , 2014 .

[25]  Jukka Hyönä,et al.  Do adult readers know how they read? Evidence from eye movement patterns and verbal reports. , 2006, British journal of psychology.

[26]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[27]  Mike Rinck,et al.  Chapter 16 – Eye Movement Measures to Study Global Text Processing , 2003 .

[28]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[29]  Geoffrey Underwood,et al.  Eye Fixations Predict Reading Comprehension: The Relationships between Reading Skill, Reading Speed, and Visual Inspection , 1990, Language and speech.

[30]  Johanna K. Kaakinen,et al.  Individual Differences in Reading to Summarize Expository Text: Evidence From Eye Fixation Patterns , 2002 .

[31]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[32]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[33]  K Rayner,et al.  Eye movements and the perceptual span in beginning and skilled readers. , 1986, Journal of experimental child psychology.

[34]  V. Kuperman,et al.  Effects of individual differences in verbal skills on eye-movement patterns during sentence reading. , 2011, Journal of memory and language.

[35]  Sarah A. Gerson,et al.  Physics is Harder than Psychology...Or Is It?: Developmental Differences in Calibration of Domain-Specific Texts , 2007 .

[36]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[37]  John M Henderson,et al.  Stable individual differences across images in human saccadic eye movements. , 2008, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[38]  Alexander Pollatsek,et al.  Immediate and delayed effects of word frequency and word length on eye movements in reading: a reversed delayed effect of word length. , 2008, Journal of experimental psychology. Human perception and performance.

[39]  A. Guérin-Dugué,et al.  An analysis of reading skill development using E-Z Reader , 2015, Journal of cognitive psychology.

[40]  David R. Anderson,et al.  Multimodel Inference , 2004 .