An integrated model of word processing and eye-movement control during Chinese reading.

In the Chinese writing system, there are no interword spaces to mark word boundaries. To understand how Chinese readers conquer this challenge, we constructed an integrated model of word processing and eye-movement control during Chinese reading (CRM). The model contains a word-processing module and an eye-movement control module. The word-processing module perceives new information within the perceptual span around a fixation. The model uses the interactive activation framework (McClelland & Rumelhart, 1981) to simulate word processing, but some new assumptions were made to address the word segmentation problem in Chinese reading. All the words supported by characters in the perceptual span are activated and they compete for a winner. When one word wins the competition, it is identified and it is simultaneously segmented from text. The eye-movement control module makes the decision regarding when and where to move the eyes using the activation information of word units and character units provided by the word-processing module. The model estimates how many characters can be processed during a fixation, and then makes a saccade to somewhere beyond this point. The model successfully simulated important findings on the relation between word processing and eye-movement control, how Chinese readers choose saccade targets, how Chinese readers segment words with ambiguous boundaries, and how Chinese readers process information with parafoveal vision during Chinese sentence reading. The current model thus provides insights on how Chinese readers address some important challenges, such as word segmentation and saccade-target selection. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

[1]  Suiping Wang,et al.  Do Chinese readers obtain preview benefit from word n + 2? Evidence from eye movements. , 2009, Journal of experimental psychology. Human perception and performance.

[2]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[3]  K. Rayner,et al.  Word segmentation of overlapping ambiguous strings during Chinese reading. , 2014, Journal of experimental psychology. Human perception and performance.

[4]  Xingshan Li,et al.  The effect of word frequency and parafoveal preview on saccade length during the reading of Chinese. , 2016, Journal of experimental psychology. Human perception and performance.

[5]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[6]  Simon P Liversedge,et al.  Rayner's 1979 Paper , 2009 .

[7]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[8]  Suiping Wang,et al.  Plausibility effects when reading one- and two-character words in Chinese: evidence from eye movements. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Jie-Li Tsai,et al.  Usage of statistical cues for word boundary in reading Chinese sentences , 2012 .

[10]  Jonathan Grainger,et al.  On coding the position of letters in words: a test of two models. , 2011, Experimental psychology.

[11]  D. Hung,et al.  Use of phonological codes for Chinese characters: Evidence from processing of parafoveal preview when reading sentences , 2004, Brain and Language.

[12]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[13]  A. Pollatsek,et al.  Dividing lines at the word boundary position helps reading in Chinese , 2012, Psychonomic bulletin & review.

[14]  Barbara J. Juhasz,et al.  The effect of word predictability on the eye movements of Chinese readers , 2005, Psychonomic bulletin & review.

[15]  Reinhold Kliegl,et al.  CarPrice versus CarpRice: Word boundary ambiguity influences saccade target selection during the reading of Chinese sentences. , 2016, Journal of experimental psychology. Learning, memory, and cognition.

[16]  S. Grossberg A Theory of Visual Coding : Memory , and Development , 2010 .

[17]  G. McConkie,et al.  Asymmetry of the perceptual span in reading , 1976 .

[18]  Xingshan Li,et al.  The uniqueness of word superiority effect in Chinese reading , 2012 .

[19]  Erik D. Reichle,et al.  Chinese versus English: Insights on Cognition during Reading , 2017, Trends in Cognitive Sciences.

[20]  G. Logan,et al.  Object-based attention in Chinese readers of Chinese words: Beyond Gestalt principles , 2008, Psychonomic bulletin & review.

[21]  S. Liversedge,et al.  Eye movements during Chinese reading , 2013 .

[22]  R. Kliegl,et al.  Readers of Chinese extract semantic information from parafoveal words , 2009, Psychonomic bulletin & review.

[23]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[24]  G. M. Reicher Perceptual recognition as a function of meaninfulness of stimulus material. , 1969, Journal of experimental psychology.

[25]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[26]  Chao-Ming Cheng,et al.  Perception of Chinese characters. , 1981 .

[27]  The processing of Chinese compound words with ambiguous morphemes in sentence context , 2018, Quarterly journal of experimental psychology.

[28]  Simon P. Liversedge,et al.  Foveal processing difficulty does not modulate non-foveal orthographic influences on fixation positions , 2006, Vision Research.

[29]  Alexander Pollatsek,et al.  The interpretation of ambiguous trimorphemic words in sentence context , 2010, Psychonomic bulletin & review.

[30]  G. McConkie,et al.  What guides a reader's eye movements? , 1976, Vision Research.

[31]  D. Hung,et al.  Eye movements and parafoveal word processing in reading Chinese , 2008, Memory & cognition.

[32]  Erik D. Reichle,et al.  Models of Chinese Reading: Review and Analysis. , 2018, Cognitive science.

[33]  Xuejun Bai,et al.  Interword spacing and landing position effects during Chinese reading in children and adults. , 2013, Journal of experimental psychology. Human perception and performance.

[34]  A Pollatsek,et al.  The role of phonological codes in integrating information across saccadic eye movements in Chinese character identification. , 2000, Journal of experimental psychology. Human perception and performance.

[35]  Roberto Brunelli,et al.  MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES , 2001 .

[36]  R. Radach,et al.  Early parafoveal processing in reading Chinese sentences. , 2009, Acta psychologica.

[37]  K. Rayner,et al.  Reading spaced and unspaced Chinese text: evidence from eye movements. , 2008, Journal of experimental psychology. Human perception and performance.

[38]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[39]  P. W. Kerr,et al.  Eye movement control during reading: I. The location of initial eye fixations on words , 1987, Vision Research.

[40]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[41]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[42]  Keith Rayner,et al.  Parafoveal processing in reading , 2011, Attention, Perception, & Psychophysics.

[43]  Ralph Radach,et al.  Time course of linguistic information extraction from consecutive words during eye fixations in reading. , 2005, Journal of experimental psychology. Human perception and performance.

[44]  H. Shu,et al.  Brain networks associated with sublexical properties of Chinese characters , 2011, Brain and Language.

[45]  A. Inhoff,et al.  Use of parafoveally visible characters during the reading of Chinese sentences. , 2002, Journal of experimental psychology. Human perception and performance.

[46]  T Ishida,et al.  Temporal properties of information extraction in reading studied by a text-mask replacement technique. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[47]  Kyle R. Cave,et al.  On the segmentation of Chinese words during reading , 2009, Cognitive Psychology.

[48]  Xuejun Bai,et al.  The effect of word and character frequency on the eye movements of Chinese readers. , 2006, British journal of psychology.

[49]  Alexander Pollatsek,et al.  Encoding multiple words simultaneously in reading is implausible , 2009, Trends in Cognitive Sciences.

[50]  C. A. Weaver,et al.  Psychology of Reading , 2012 .

[51]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[52]  Xingshan Li,et al.  The effects of character transposition within and across words in Chinese reading , 2015, Attention, perception & psychophysics.

[53]  Alexander Pollatsek,et al.  Serial processing is consistent with the time course of linguistic information extraction from consecutive words during eye fixations in reading: a response to Inhoff, Eiter, and Radach (2005). , 2006, Journal of experimental psychology. Human perception and performance.

[54]  J. Grainger,et al.  OB1-Reader: A Model of Word Recognition and Eye Movements in Text Reading , 2018, Psychological review.

[55]  Ronan G. Reilly,et al.  Some empirical tests of an interactive activation model of eye movement control in reading , 2006, Cognitive Systems Research.

[56]  Z. A. Trapeznikova On the Interaction of , 1959 .

[57]  W. Becker,et al.  An analysis of the saccadic system by means of double step stimuli , 1979, Vision Research.

[58]  Sarah J. White,et al.  Eye movements and the modulation of parafoveal processing by foveal processing difficulty: A reexamination , 2005, Psychonomic bulletin & review.

[59]  R. Walker,et al.  A model of saccade generation based on parallel processing and competitive inhibition , 1999, Behavioral and Brain Sciences.

[60]  Jukka Hyönä,et al.  Universality in eye movements and reading: A trilingual investigation , 2016, Cognition.

[61]  Charles A. Perfetti,et al.  The time course of graphic, phonological, and semantic activation in Chinese character identification , 1998 .

[62]  K. Rayner,et al.  Eye Movement Control during Reading: Evidence for Direct Control , 1981, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[63]  George W. McConkie,et al.  Reading Chinese: Some basic eye-movement characteristics. , 1999 .

[64]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[65]  Alexander Pollatsek,et al.  There is no relationship between preferred viewing location and word segmentation in Chinese reading , 2015 .

[66]  D. Balota,et al.  The interaction of contextual constraints and parafoveal visual information in reading , 1985, Cognitive Psychology.

[67]  Guojie Ma,et al.  Word Boundaries Affect Visual Attention in Chinese Reading , 2012, PloS one.

[68]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[69]  Xingshan Li,et al.  Character order processing in Chinese reading. , 2015, Journal of experimental psychology. Human perception and performance.

[70]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[71]  Ming Yan,et al.  Flexible saccade-target selection in Chinese reading , 2010, Quarterly journal of experimental psychology.

[72]  K. Rayner,et al.  Asymmetry of the effective visual field in reading , 1980, Perception & psychophysics.

[73]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[74]  Alexander Pollatsek,et al.  Extending the E-Z Reader Model of Eye Movement Control to Chinese Readers , 2007, Cogn. Sci..

[75]  A. Inhoff,et al.  The perceptual span and oculomotor activity during the reading of Chinese sentences. , 1998, Journal of experimental psychology. Human perception and performance.

[76]  K. Rayner,et al.  Reading is fundamentally similar across disparate writing systems: a systematic characterization of how words and characters influence eye movements in Chinese reading. , 2014, Journal of experimental psychology. General.

[77]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[78]  Saccade target selection in Chinese reading , 2015, Psychonomic bulletin & review.

[79]  Xingshan Li,et al.  Eye movement guidance in Chinese reading: Is there a preferred viewing location? , 2011, Vision Research.

[80]  Alexander Pollatsek,et al.  Word properties of a fixated region affect outgoing saccade length in Chinese reading , 2013, Vision Research.

[81]  S. Liversedge,et al.  Investigating Word Length Effects in Chinese Reading , 2018, Journal of experimental psychology. Human perception and performance.

[82]  Alexander Pollatsek,et al.  The Role of Words in Chinese Reading , 2015 .

[83]  Reinhold Kliegl,et al.  Parafoveal load of word N+1 modulates preprocessing effectiveness of word N+2 in Chinese reading. , 2010, Journal of experimental psychology. Human perception and performance.

[84]  J. H. Bertera,et al.  The availability of useful information to the right of fixation in reading , 1982, Perception & psychophysics.

[85]  K. Rayner Eye Guidance in Reading: Fixation Locations within Words , 1979, Perception.

[86]  Xingshan Li,et al.  Parafoveal processing affects outgoing saccade length during the reading of Chinese. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[87]  Heiner Deubel,et al.  The mind's eye : cognitive and applied aspects of eye movement research , 2003 .

[88]  Ying Liu,et al.  The lexical constituency model: some implications of research on Chinese for general theories of reading. , 2005, Psychological review.

[89]  Ralph Radach,et al.  Temporal overlap in the linguistic processing of successive words in reading: reply to Pollatsek, Reichle, and Rayner (2006a). , 2006, Journal of experimental psychology. Human perception and performance.

[90]  K. Rayner The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[91]  F. Sun,et al.  Comparative patterns of reading eye movement in Chinese and English , 1985, Perception & psychophysics.

[92]  Jie-Li Tsai,et al.  Where Do Chinese Readers Send Their Eyes , 2003 .

[93]  Xingshan Li,et al.  Early, but not overwhelming: The effect of prior context on segmenting overlapping ambiguous strings when reading Chinese , 2020, Quarterly journal of experimental psychology.

[94]  K. Rayner,et al.  The advantage of word-based processing in Chinese reading: evidence from eye movements. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[95]  David Zola,et al.  3 – The Temporal Characteristics of Visual Information Extraction during Reading , 1983 .

[96]  K. Rayner,et al.  Effects of contextual constraint on eye movements in reading: A further examination , 1996, Psychonomic bulletin & review.

[97]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[98]  A. Pollatsek,et al.  Word knowledge influences character perception , 2011, Psychonomic bulletin & review.

[99]  J. Henderson,et al.  Effects of foveal processing difficulty on the perceptual span in reading: implications for attention and eye movement control. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[100]  C. Clifton,et al.  Determinants of parafoveal preview benefit in high and low working memory capacity readers: implications for eye movement control. , 1995, Journal of experimental psychology. Learning, memory, and cognition.