Eye movements during text reading align with the rate of speech production

Across languages, the speech signal is characterized by a ~4-5 Hz rhythm of the amplitude modulation spectrum, reflecting the processing of linguistic information chunks approximately every 200 ms. Interestingly, ~200 ms is also the typical eye-fixation duration during reading. Prompted by this observation, we estimated the frequency at which readers sample text, and demonstrate that they read sentences at a rate of ~5 Hz. We then examined the generality of this finding in a meta analysis. While replicating the experimentally measured 5 Hz sampling rate in the language in which it was obtained, i.e., German, we observe that fixation-based sampling frequencies vary across languages between 3.1 and 5.2 Hz, with the majority of languages lying between 4 and 5 Hz. Remarkably, we identify a systematic rate reduction from easy to difficult writing systems. Reading in easy-to-process writing systems thus is aligned with the rhythm of speech, which may constitute an upper boundary for reading. We argue that reading is likely tuned to supply information to linguistic processes at an optimal rate, coincident with the typical rate of speech. Significance Statement Across languages, speech is produced and perceived at a rate of 4-5Hz. When listening to speech, our brain ‘picks up’ this temporal structure. Here we report that during reading, our eyes sample text at the same rate. We demonstrate this empirically in one language, and generalize this finding in a meta analysis of 124 empirical studies, covering 14 different languages. Reading rates vary between 3.1 and 5.2 Hz - i.e., broadly in the range of the speech signal. We demonstrate that this variance is determined by the orthographical difficulty of different writing systems, and propose that the rate at which our brain processes spoken language acts as a driving force and upper limit for the voluntary control of eye movements during reading.

[1]  Erik D. Reichle,et al.  Direct lexical control of eye movements in reading: Evidence from a survival analysis of fixation durations , 2012, Cognitive Psychology.

[2]  Jie-Li Tsai,et al.  Usage of statistical cues for word boundary in reading Chinese sentences , 2012 .

[3]  K. Rayner,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition The Influence of Contextual Diversity on Eye Movements in Reading , 2013 .

[4]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[5]  D. Poeppel,et al.  Cortical Tracking of Hierarchical Linguistic Structures in Connected Speech , 2015, Nature Neuroscience.

[6]  Xenia Schmalz,et al.  Getting to the bottom of orthographic depth , 2015, Psychonomic bulletin & review.

[7]  Jinmian Yang,et al.  Preview effects of plausibility and character order in reading Chinese transposed words: evidence from eye movements , 2013 .

[8]  Keith Rayner,et al.  Processing the in the parafovea: are articles skipped automatically? , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[9]  François Christophe Egidio Pellegrino,et al.  Across-Language Perspective on Speech Information Rate , 2011 .

[10]  Lars Placke,et al.  Eye movements during the reading of compound words and the influence of lexeme meaning , 2008, Memory & cognition.

[11]  Tom Foulsham,et al.  Mind wandering in sentence reading: decoupling the link between mind and eye. , 2013, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[12]  Jochen Laubrock,et al.  Eye movement evidence for defocused attention in dysphoria--a perceptual span analysis. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  Ralph Radach,et al.  Eye movements and parafoveal processing during reading in Korean , 2012 .

[14]  Adrian Staub,et al.  The word frequency effect during sentence reading: A linear or nonlinear effect of log frequency? , 2018, Quarterly journal of experimental psychology.

[15]  Xingshan Li,et al.  Inserting spaces before and after words affects word processing differently in Chinese: Evidence from eye movements. , 2014, British Journal of Psychology.

[16]  Hwa-Wei Ko,et al.  Context Effects in Processing of Chinese Academic Words: An Eye-Tracking Investigation , 2013 .

[17]  Reinhold Kliegl,et al.  Experimental Effects and Individual Differences in Linear Mixed Models: Estimating the Relationship between Spatial, Object, and Attraction Effects in Visual Attention , 2010, Front. Psychology.

[18]  Xingshan Li,et al.  Eye movement guidance in Chinese reading: Is there a preferred viewing location? , 2011, Vision Research.

[19]  H. Wimmer,et al.  A dual-route perspective on eye movements of dyslexic readers , 2010, Cognition.

[20]  Suiping Wang,et al.  Processing of compound-word characters in reading Chinese: An eye-movement-contingent display change study , 2013, Quarterly journal of experimental psychology.

[21]  Jon Andoni Duñabeitia,et al.  NoA’s ark: Influence of the number of associates in visual word recognition , 2008, Psychonomic bulletin & review.

[22]  Sally Andrews,et al.  Lexical Quality and Eye Movements: Individual Differences in the Perceptual Span of Skilled Adult Readers , 2014, Quarterly journal of experimental psychology.

[23]  Simon P Liversedge,et al.  Preview benefit in English spaced compounds. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[24]  A. Nowacki,et al.  Understanding Equivalence and Noninferiority Testing , 2011, Journal of General Internal Medicine.

[25]  Matthew W Lowder,et al.  Word recognition during reading: The interaction between lexical repetition and frequency , 2013, Memory & cognition.

[26]  D. Poeppel,et al.  Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex , 2007, Neuron.

[27]  Chiara Reali,et al.  Role descriptions induce gender mismatch effects in eye movements during reading , 2015, Front. Psychol..

[28]  Denis Drieghe,et al.  Foveal processing and word skipping during reading , 2008, Psychonomic bulletin & review.

[29]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[30]  Insup Taylor,et al.  The Korean writing system: An alphabet? A syllabary? a logography? , 1980 .

[31]  K. Rayner,et al.  The effect of foveal and parafoveal masks on the eye movements of older and younger readers. , 2014, Psychology and aging.

[32]  L. Nygaard,et al.  Reading voices and hearing text: talker-specific auditory imagery in reading. , 2008, Journal of experimental psychology. Human perception and performance.

[33]  Simon P. Liversedge,et al.  Children’s and Adults’ On-Line Processing of Syntactically Ambiguous Sentences during Reading , 2013, PloS one.

[34]  Y. Saalmann,et al.  Rhythmic Sampling within and between Objects despite Sustained Attention at a Cued Location , 2013, Current Biology.

[35]  Ralf Engbert,et al.  Eye movements during reading of randomly shuffled text , 2010, Vision Research.

[36]  Keith Rayner,et al.  Parafoveal-foveal overlap can facilitate ongoing word identification during reading: evidence from eye movements. , 2013, Journal of experimental psychology. Human perception and performance.

[37]  Christoph Scheepers,et al.  Contextual modulation of reading rate for direct versus indirect speech quotations , 2011, Cognition.

[38]  T. Houtgast,et al.  A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria , 1985 .

[39]  David Poeppel,et al.  Theta band oscillations reflect more than entrainment: behavioral and neural evidence demonstrates an active chunking process , 2018, The European journal of neuroscience.

[40]  Elizabeth R Schotter,et al.  The effect of contextual constraint on parafoveal processing in reading. , 2015, Journal of memory and language.

[41]  Reinhold Kliegl,et al.  Reading strategy modulates parafoveal-on-foveal effects in sentence reading , 2013, Quarterly journal of experimental psychology.

[42]  K. Rayner,et al.  Mindless reading revisited: Eye movements during reading and scanning are different , 1996, Perception & psychophysics.

[43]  Ralf Engbert,et al.  Length, frequency, and predictability effects of words on eye movements in reading , 2004 .

[44]  Steven G. Luke,et al.  Stable individual differences in saccadic eye movements during reading, pseudoreading, scene viewing, and scene search. , 2014, Journal of experimental psychology. Human perception and performance.

[45]  Manuel Perea,et al.  On the flexibility of letter position coding during lexical processing: Evidence from eye movements when reading Thai , 2012, Quarterly journal of experimental psychology.

[46]  J. Henderson,et al.  Using CRISP to model global characteristics of fixation durations in scene viewing and reading with a common mechanism , 2012 .

[47]  Alexander Pollatsek,et al.  Immediate and delayed effects of word frequency and word length on eye movements in reading: a reversed delayed effect of word length. , 2008, Journal of experimental psychology. Human perception and performance.

[48]  Hazel I Blythe,et al.  Beyond decoding: phonological processing during silent reading in beginning readers. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[49]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[50]  Aniruddh D. Patel,et al.  Temporal modulations in speech and music , 2017, Neuroscience & Biobehavioral Reviews.

[51]  John M. Henderson,et al.  Morphology of Primary Visual Cortex Predicts Individual Differences in Fixation Duration during Text Reading , 2014, Journal of Cognitive Neuroscience.

[52]  J. Hyönä,et al.  Lexical predictability exerts robust effects on fixation duration, but not on initial landing position during reading. , 2009, Experimental Psychology.

[53]  Manuel Perea,et al.  Re(de)fining the orthographic neighborhood: the role of addition and deletion neighbors in lexical decision and reading. , 2009, Journal of experimental psychology. Human perception and performance.

[54]  Thomas A. Farmer,et al.  Form-to-expectation matching effects on first-pass eye movement measures during reading. , 2015, Journal of experimental psychology. Human perception and performance.

[55]  Avital Deutsch,et al.  The flexibility of letter-position flexibility: evidence from eye movements in reading Hebrew. , 2013, Journal of experimental psychology. Human perception and performance.

[56]  Florian Hutzler,et al.  A similar correction mechanism in slow and fluent readers after suboptimal landing positions , 2014, Front. Hum. Neurosci..

[57]  Heather Winskel,et al.  Orthographic and phonological parafoveal processing of consonants, vowels, and tones when reading Thai , 2011 .

[58]  Keith Rayner,et al.  Semantic preview benefit in reading English: The effect of initial letter capitalization. , 2014, Journal of experimental psychology. Human perception and performance.

[59]  J. Henderson,et al.  Neural correlates of active vision: An fMRI comparison of natural reading and scene viewing , 2015, Neuropsychologia.

[60]  Keith Rayner,et al.  The role of age of acquisition and word frequency in reading: Evidence from eye fixation durations , 2006 .

[61]  Alexander Pollatsek,et al.  There is no relationship between preferred viewing location and word segmentation in Chinese reading , 2015 .

[62]  Sarah J. White,et al.  Distributional effects of word frequency on eye fixation durations. , 2010, Journal of experimental psychology. Human perception and performance.

[63]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[64]  Jeanette Altarriba,et al.  Emotion effects during reading: Influence of an emotion target word on eye movements and processing , 2015, Cognition & emotion.

[65]  Korbinian Moeller,et al.  Same Same, but Different: Word and Sentence Reading in German and English , 2016 .

[66]  Rebecca L Johnson,et al.  The importance of the first and last letter in words during sentence reading. , 2012, Acta psychologica.

[67]  Fabio Richlan,et al.  Parafoveal preprocessing in reading revisited: evidence from a novel preview manipulation. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[68]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[69]  Jukka Hyönä,et al.  The role of interword spacing in reading Japanese: An eye movement study , 2007, Vision Research.

[70]  Wei Zhou,et al.  Reading proficiency modulates parafoveal processing efficiency: evidence from reading Chinese as a second language. , 2014, Acta psychologica.

[71]  Steven Greenberg,et al.  Temporal properties of spontaneous speech - a syllable-centric perspective , 2003, J. Phonetics.

[72]  Tessa Warren,et al.  Investigating effects of selectional restriction violations and plausibility violation severity on eye-movements in reading , 2007, Psychonomic bulletin & review.

[73]  P. H. Seymour,et al.  Foundation literacy acquisition in European orthographies. , 2003, British journal of psychology.

[74]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[75]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[76]  Benjamin Gagl,et al.  Blue hypertext is a good design decision: no perceptual disadvantage in reading and successful highlighting of relevant information , 2016, PeerJ.

[77]  Wouter Duyck,et al.  An eye movement corpus study of the age-of-acquisition effect , 2017, Psychonomic bulletin & review.

[78]  Fabio Richlan,et al.  Oscillatory Brain Dynamics during Sentence Reading: A Fixation-Related Spectral Perturbation Analysis , 2016, Front. Hum. Neurosci..

[79]  Carrick C. Williams,et al.  Eye movements during information processing tasks: Individual differences and cultural effects , 2007, Vision Research.

[80]  Kara D. Federmeier,et al.  Cross-age comparisons reveal multiple strategies for lexical ambiguity resolution during natural reading. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[81]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[82]  K. Rayner,et al.  Frequency drives lexical access in reading but not in speaking: the frequency-lag hypothesis. , 2011, Journal of experimental psychology. General.

[83]  Pablo Gomez,et al.  Does Extra Interletter Spacing Help Text Reading in Skilled Adult Readers? , 2016, The Spanish Journal of Psychology.

[84]  J. V. Berkum,et al.  On the use of verb-based implicit causality in sentence comprehension : Evidence from self-paced reading and eye tracking , 2006 .

[85]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[86]  K. Rayner,et al.  Eye movements and word skipping during reading: effects of word length and predictability. , 2011, Journal of experimental psychology. Human perception and performance.

[87]  Sarah Risse,et al.  Word frequency in fast priming: Evidence for immediate cognitive control of eye movements during reading , 2014, Visual cognition.

[88]  Ralf Engbert,et al.  The IOVP effect in mindless reading: Experiment and modeling , 2007, Vision Research.

[89]  Barbara J. Juhasz,et al.  Effects of morphological families on English compound word recognition: A multitask investigation , 2011 .

[90]  Steven G. Luke,et al.  The psychologist said quickly, “Dialogue descriptions modulate reading speed!” , 2013, Memory & cognition.

[91]  D. Hung,et al.  Eye movements and parafoveal word processing in reading Chinese , 2008, Memory & cognition.

[92]  R. Hartsuiker,et al.  The influence of semantic constraints on bilingual word recognition during sentence reading , 2011 .

[93]  Ming Yan,et al.  Flexible saccade-target selection in Chinese reading , 2010, Quarterly journal of experimental psychology.

[94]  Jie-Li Tsai,et al.  Parafoveal semantic information extraction in traditional Chinese reading. , 2012, Acta psychologica.

[95]  Keith Rayner,et al.  Skipping syntactically illegal the previews: The role of predictability. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[96]  G. Feng,et al.  Development of text reading in Japanese: an eye movement study , 2014 .

[97]  Steven Frisson,et al.  Competition between orthographically and phonologically similar words during sentence reading: Evidence from eye movements , 2014 .

[98]  Simon P. Liversedge,et al.  Using Eye Movements to Investigate Word Frequency Effects in Children's Sentence Reading , 2013 .

[99]  Richard Shillcock,et al.  Patients with hemianopic alexia adopt an inefficient eye movement strategy when reading text , 2006 .

[100]  Keith Rayner,et al.  The effect of high- and low-frequency previews and sentential fit on word skipping during reading. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[101]  Kathryn Bock,et al.  Resolving Conflicts in Natural and Grammatical Gender Agreement: Evidence from Eye Movements , 2015, Journal of psycholinguistic research.

[102]  Wouter Duyck,et al.  Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading , 2017, Behavior research methods.

[103]  D. Titone,et al.  Bilingual lexical access during L1 sentence reading: The effects of L2 knowledge, semantic constraint, and L1-L2 intermixing. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[104]  John M. Henderson,et al.  Toward Semantics in the Wild: Activation to Manipulable Nouns in Naturalistic Reading , 2016, The Journal of Neuroscience.

[105]  Keith Rayner,et al.  Reading transposed text: effects of transposed letter distance and consonant-vowel status on eye movements , 2014, Attention, Perception, & Psychophysics.

[106]  Hwa-Wei Ko,et al.  Investigating the effects of background knowledge on Chinese word processing during text reading: evidence from eye movements , 2014 .

[107]  Jane Ashby,et al.  Prosody in Skilled Silent Reading: Evidence from Eye Movements. , 2006 .

[108]  Kara D. Federmeier,et al.  Subsequent to suppression: Downstream comprehension consequences of noun/verb ambiguity in natural reading. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[109]  Marc Brysbaert,et al.  Interhemispheric Communication Influences Reading Behavior , 2013, Journal of Cognitive Neuroscience.

[110]  D. Lakens Equivalence Tests , 2017, Social psychological and personality science.

[111]  Keith Rayner,et al.  Children's and Adults’ Processing of Anomaly and Implausibility during Reading: Evidence from Eye Movements , 2008, Quarterly journal of experimental psychology.

[112]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[113]  Hinze Hogendoorn,et al.  Voluntary Saccadic Eye Movements Ride the Attentional Rhythm , 2016, Journal of Cognitive Neuroscience.

[114]  Yen-Chi Chen,et al.  GraphCom: A multidimensional measure of graphic complexity applied to 131 written languages , 2018, Behavior research methods.

[115]  Jukka Hyönä,et al.  Universality in eye movements and reading: A trilingual investigation , 2016, Cognition.

[116]  Albrecht W. Inhoff,et al.  Eye position changes during reading fixations are spatially selective , 2008, Vision Research.

[117]  Lynn Huestegge,et al.  Long-term effects of cannabis on eye movement control in reading , 2010, Psychopharmacology.

[118]  D. Titone,et al.  Bilingual lexical access in context: evidence from eye movements during reading. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[119]  Keith Rayner,et al.  Eye movements when reading transposed text: the importance of word-beginning letters. , 2008, Journal of experimental psychology. Human perception and performance.

[120]  J. O'Regan,et al.  Fixation location effects on fixation durations during reading: an inverted optimal viewing position effect , 2001, Vision Research.

[121]  Keith Rayner,et al.  Don’t Believe What You Read (Only Once) , 2014, Psychological science.

[122]  Sungryong Koh,et al.  Processing metalinguistic negation: Evidence from eye-tracking experiments , 2013 .

[123]  John M. Henderson,et al.  Neural correlates of fixation duration in natural reading: Evidence from fixation-related fMRI , 2015, NeuroImage.

[124]  D. Share On the Anglocentricities of current reading research and practice: the perils of overreliance on an "outlier" orthography. , 2008, Psychological bulletin.

[125]  Johanna K. Kaakinen,et al.  Task effects on eye movements during reading. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[126]  Elizabeth R Schotter,et al.  Task effects reveal cognitive flexibility responding to frequency and predictability: Evidence from eye movements in reading and proofreading , 2014, Cognition.

[127]  Adrian Staub,et al.  The effect of lexical predictability on distributions of eye fixation durations , 2011, Psychonomic bulletin & review.

[128]  P. Schyns,et al.  Speech Rhythms and Multiplexed Oscillatory Sensory Coding in the Human Brain , 2013, PLoS biology.

[129]  Michael Frazier,et al.  Wh-filler-gap dependency formation guides reflexive antecedent search , 2015, Front. Psychol..

[130]  Keith Rayner,et al.  The orthographic uniqueness point and eye movements during reading. , 2006, British journal of psychology.

[131]  Birk Diedenhofen,et al.  cocor: A Comprehensive Solution for the Statistical Comparison of Correlations , 2015, PloS one.

[132]  Heather Winskel,et al.  Eye movements when reading spaced and unspaced Thai and English : a comparison of Thai–English bilinguals and English monolinguals , 2009 .

[133]  J. O'Regan,et al.  Mindless reading: Eye-movement characteristics are similar in scanning letter strings and reading texts , 1995, Perception & psychophysics.

[134]  Lynn Huestegge,et al.  Language switching between sentences in reading: Exogenous and endogenous effects on eye movements and comprehension* , 2014, Bilingualism: Language and Cognition.

[135]  V. Kuperman,et al.  Effects of individual differences in verbal skills on eye-movement patterns during sentence reading. , 2011, Journal of memory and language.

[136]  Kara D. Federmeier,et al.  Do morphemes matter when reading compound words with transposed letters? Evidence from eye-tracking and event-related potentials , 2016, Language, cognition and neuroscience.

[137]  Christian Lorenzi,et al.  A cross-linguistic study of speech modulation spectra. , 2017, The Journal of the Acoustical Society of America.

[138]  Lee Friedman,et al.  A novel evaluation of two related and two independent algorithms for eye movement classification during reading , 2018, Behavior Research Methods.

[139]  S. McDonald Effects of number-of-letters on eye movements during reading are independent from effects of spatial word length , 2006 .

[140]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[141]  Shravan Vasishth,et al.  Brain Responses to World Knowledge Violations: A Comparison of Stimulus- and Fixation-triggered Event-related Potentials and Neural Oscillations , 2015, Journal of Cognitive Neuroscience.

[142]  U. Goswami,et al.  Speech rhythm and temporal structure: Converging perspectives? , 2013 .

[143]  P. Gordon,et al.  The interplay of discourse congruence and lexical association during sentence processing: Evidence from ERPs and eye tracking. , 2007, Journal of memory and language.

[144]  Xingshan Li,et al.  Using support vector machines to identify literacy skills: Evidence from eye movements , 2017, Behavior research methods.

[145]  Avital Deutsch,et al.  Decomposition in a non-concatenated morphological structure involves more than just the roots: Evidence from fast priming , 2018, Quarterly journal of experimental psychology.

[146]  Keith Rayner,et al.  Eye movement latencies for parafoveally presented words , 1978 .

[147]  Emmanuel Keuleers,et al.  Frequency effects in monolingual and bilingual natural reading , 2015, Psychonomic bulletin & review.

[148]  H. Wimmer,et al.  Characteristics of developmental dyslexia in a regular writing system , 1993, Applied Psycholinguistics.

[149]  Wonil Choi,et al.  Word skipping during sentence reading: effects of lexicality on parafoveal processing , 2014, Attention, perception & psychophysics.

[150]  Ming Yan,et al.  Syllabic tone articulation influences the identification and use of words during Chinese sentence reading: Evidence from ERP and eye movement recordings , 2016, Cognitive, affective & behavioral neuroscience.

[151]  Peter C. Gordon,et al.  Print exposure modulates the effects of repetition priming during sentence reading , 2017, Psychonomic bulletin & review.

[152]  Elizabeth R Schotter,et al.  Preview benefit in speaking occurs regardless of preview timing , 2013, Psychonomic Bulletin & Review.

[153]  U. Goswami,et al.  Impaired extraction of speech rhythm from temporal modulation patterns in speech in developmental dyslexia , 2014, Front. Hum. Neurosci..

[154]  Denis Burnham,et al.  Atypical cortical entrainment to speech in the right hemisphere underpins phonemic deficits in dyslexia , 2018, NeuroImage.