A Discriminative Model for Identifying Readers and Assessing Text Comprehension from Eye Movements

We study the problem of inferring readers’ identities and estimating their level of text comprehension from observations of their eye movements during reading. We develop a generative model of individual gaze patterns (scanpaths) that makes use of lexical features of the fixated words. Using this generative model, we derive a Fisher-score representation of eye-movement sequences. We study whether a Fisher-SVM with this Fisher kernel and several reference methods are able to identify readers and estimate their level of text comprehension based on eye-tracking data. While none of the methods are able to estimate text comprehension accurately, we find that the SVM with Fisher kernel excels at identifying readers.

[1]  W. Klein,et al.  Das Digitale Wörterbuch der Deutschen Sprache (DWDS) , 2010 .

[2]  Barbara J. Juhasz,et al.  The effect of plausibility on eye movements in reading. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Cecilia R. Aragon,et al.  Biometric identification via an oculomotor plant mathematical model , 2010, ETRA.

[4]  Ioannis Rigas,et al.  Biometric identification based on the eye movements and graph matching techniques , 2012, Pattern Recognit. Lett..

[5]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[6]  Ralf Engbert,et al.  Length, frequency, and predictability effects of words on eye movements in reading , 2004 .

[7]  Tamás D. Gedeon,et al.  Predicting reading comprehension scores from eye movements using artificial neural networks and fuzzy output error , 2014, Artif. Intell. Res..

[8]  Guy T. Buswell,et al.  Studies in the psychology of reading , 1952 .

[9]  Leana Copeland,et al.  Measuring reading comprehension using eye movements , 2013, 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom).

[10]  Daniel Boujard,et al.  Zell- und Molekularbiologie im Überblick , 2014 .

[11]  Tomi Kinnunen,et al.  Eye-Movements as a Biometric , 2005, SCIA.

[12]  Reinhold Kliegl,et al.  A Semiparametric Model for Bayesian Reader Identification , 2016, EMNLP.

[13]  Johanna K. Kaa.  Perspective effects in repeated reading: An eye movement study , 2007 .

[14]  H. Pfeifer,et al.  Experimentalphysik 4, Kern-, Teilchen- und Atomphysik , 1999 .

[15]  h.c. Harry Pfeifer,et al.  Experimentalphysik 3, Atome, Moleküle und Festkörper , 1997 .

[16]  C. A. Weaver,et al.  Psychology of Reading , 2012 .

[17]  K. Rayner,et al.  Eye Movements as Reflections of Comprehension Processes in Reading , 2006 .

[18]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[19]  Margaret Floy Washburn,et al.  The Psychology And Pedagogy Of Reading , 1908 .

[20]  Alexander Geyken,et al.  dlexDB : eine lexikalische Datenbank für die psychologische und linguistische Forschung , 2011 .

[21]  Reinhold Kliegl,et al.  A Model of Individual Differences in Gaze Control During Reading , 2014, EMNLP.

[22]  G. McConkie,et al.  What guides a reader's eye movements? , 1976, Vision Research.

[23]  Miles A. Tinker.  Studies in the Psychology of Reading. , 1953 .

[24]  K. Rayner,et al.  Parafoveal word processing during eye fixations in reading: Effects of word frequency , 1986, Perception & psychophysics.

[25]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[26]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[27]  Barbara J. Juhasz,et al.  Eye movements and the use of parafoveal word length information in reading. , 2008, Journal of experimental psychology. Human perception and performance.

[28]  Ioannis Rigas,et al.  Human eye movements as a trait for biometrical identification , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[29]  F. T.,et al.  Ökologie , 2005, Naturwissenschaften.

[30]  K. Rayner,et al.  Eye movements in reading words and sentences , 2007 .

[31]  Geoffrey Underwood,et al.  Eye Fixations Predict Reading Comprehension: The Relationships between Reading Skill, Reading Speed, and Visual Inspection , 1990, Language and speech.

[32]  Oksana Ableitner.  Einführung in die Molekularbiologie , 2014 .

[33]  Alexander Pollatsek,et al.  The time course of plausibility effects on eye movements in reading: evidence from noun-noun compounds. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[34]  B. Erdmann,et al.  Psychologische Untersuchungen über das Lesen: Auf experimenteller Grundlage , 1899 .

[35]  Tamás D. Gedeon,et al.  Fuzzy Output Error as the Performance Function for Training Artificial Neural Networks to Predict Reading Comprehension from Eye Gaze , 2014, ICONIP.

[36]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[37]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[38]  Oleg V. Komogortsev,et al.  Biometric identification via eye movement scanpaths in reading , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[39]  Keith Rayner,et al.  Effects of context on eye movements when reading about possible and impossible events. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Peter P. Afflerbach,et al.  Handbook of Individual Differences in Reading : Reader, Text, and Context , 2015 .

[41]  P. Dodwell,et al.  Saccadic eye movements during reading , 1979, Brain and Language.

[42]  K Rayner,et al.  Saccade size in reading depends upon character spaces and not visual angle , 1981, Perception & psychophysics.

[43]  K. Rayner,et al.  Eye movements in reading: Psycholinguistic studies. , 1994 .

[44]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[45]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.