The Bayesian reader: explaining word recognition as an optimal Bayesian decision process.

This article presents a theory of visual word recognition that assumes that, in the tasks of word identification, lexical decision, and semantic categorization, human readers behave as optimal Bayesian decision makers. This leads to the development of a computational model of word recognition, the Bayesian reader. The Bayesian reader successfully simulates some of the most significant data on human reading. The model accounts for the nature of the function relating word frequency to reaction time and identification threshold, the effects of neighborhood density and its interaction with frequency, and the variation in the pattern of neighborhood density effects seen in different experimental tasks. Both the general behavior of the model and the way the model predicts different patterns of results in different tasks follow entirely from the assumption that human readers approximate optimal Bayesian decision makers.

[1]  D. D. Wheeler Processes in word recognition , 1970 .

[2]  M. Page,et al.  Connectionist modelling in psychology: A localist manifesto , 2000, Behavioral and Brain Sciences.

[3]  Gary E. Raney,et al.  Eye movement control in reading: a comparison of two types of models. , 1996, Journal of experimental psychology. Human perception and performance.

[4]  C. A. Becker Allocation of attention during visual word recognition. , 1976, Journal of experimental psychology. Human perception and performance.

[5]  N. Chater,et al.  Ten years of the rational analysis of cognition , 1999, Trends in Cognitive Sciences.

[6]  F M Marchetti,et al.  On the word-superiority effect , 1986, Psychological research.

[7]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[8]  Yasushi Hino,et al.  Orthographic neighbourhood effects in parallel distributed processing models. , 1999 .

[9]  K. Rayner,et al.  Effects of contextual predictability and transitional probability on eye movements during reading. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[10]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[11]  R. Solomon,et al.  Frequency of usage as a determinant of recognition thresholds for words. , 1952, Journal of experimental psychology.

[12]  B. Bergum,et al.  Attention and Performance VI , 1978 .

[13]  Jonathan Grainger,et al.  Blocking by word frequency and neighborhood density in visual word recognition: A task-specific response criteria account , 2004, Memory & cognition.

[14]  Michael C. Mozer,et al.  A Rational Analysis of Cognitive Control in a Speeded Discrimination Task , 2001, NIPS.

[15]  S. L. Ehrenreich,et al.  Structure and Search of the Internal Lexicon. , 1979 .

[16]  P. Luce,et al.  A computational analysis of uniqueness points in auditory word recognition , 1986, Perception & psychophysics.

[17]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[18]  R W Schvaneveldt,et al.  An activation--verification model for letter and word recognition: the word-superiority effect. , 1982, Psychological review.

[19]  Barry Gordon,et al.  Lexical access and lexical decision: Mechanisms of frequency sensitivity. , 1983 .

[20]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[21]  D. Howes On the interpretation of word frequency as a variable affecting speed of recognition. , 1954, Journal of experimental psychology.

[22]  Dennis Norris,et al.  Word recognition: Context effects without priming , 1986, Cognition.

[23]  A. Jacobs,et al.  Neighborhood frequency effects and letter visibility in visual word recognition , 1992, Perception & psychophysics.

[24]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[25]  John R. Anderson,et al.  Human memory: An adaptive perspective. , 1989 .

[26]  Jennifer M. Rodd,et al.  When do leotards get their spots? Semantic activation of lexical neighbors in visual word recognition , 2004, Psychonomic bulletin & review.

[27]  D. Balota,et al.  Word frequency, repetition, and lexicality effects in word recognition tasks: beyond measures of central tendency. , 1999, Journal of experimental psychology. General.

[28]  S. Andrews,et al.  Distinguishing common and task-specific processes in word identification: a matter of some moment? , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[29]  Max Coltheart,et al.  Access to the internal lexicon , 1977 .

[30]  M. Treisman A Theory of the Identification of Complex Stimuli with an Application to Word Recognition. , 1978 .

[31]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[32]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[33]  Alan L. Yuille,et al.  Probabilistic Motion Estimation Based on Temporal Coherence , 2000, Neural Computation.

[34]  Yasushi Hino,et al.  Neighborhood Size and Neighborhood Frequency Effects in Word Recognition , 1995 .

[35]  J Grainger,et al.  Neighborhood frequency effects in visual word recognition: A comparison of lexical decision and masked identification latencies , 1990, Perception & psychophysics.

[36]  W S Murray,et al.  Serial mechanisms in lexical access: the rank hypothesis. , 2004, Psychological review.

[37]  D. Kersten,et al.  Illusions, perception and Bayes , 2002, Nature Neuroscience.

[38]  Nick Chater,et al.  A rational analysis of the selection task as optimal data selection. , 1994 .

[39]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[40]  D. Broadbent Word-frequency effect and response bias. , 1967, Psychological review.

[41]  C. Mckenzie The Accuracy of Intuitive Judgment Strategies: Covariation Assessment and Bayesian Inference , 1994, Cognitive Psychology.

[42]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[43]  C. P. Whaley Word–nonword classification time. , 1978 .

[44]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[45]  Anne Cutler,et al.  Twenty-first century psycholinguistics : four cornerstones , 2005 .

[46]  Erik D. Reichle,et al.  Eye movement control in reading: accounting for initial fixation locations and refixations within the E-Z Reader model , 1999, Vision Research.

[47]  J. Raaijmakers,et al.  A criterion-shift model for enhanced discriminability in perceptual identification: A note on the counter model , 2000, Psychonomic bulletin & review.

[48]  D. Balota,et al.  The locus of word-frequency effects in the pronunciation task: Lexical access and/or production? ☆ , 1985 .

[49]  J J JENKINS,et al.  The durational threshold of visual recognition as a function of word-frequency. , 1954, The American journal of psychology.

[50]  R. Shillcock,et al.  Rethinking the Word Frequency Effect: The Neglected Role of Distributional Information in Lexical Processing , 2001, Language and speech.

[51]  D. Besner,et al.  Reading pseudohomophones: Implications for models of pronunciation assembly and the locus of word-frequency effects in naming. , 1987 .

[52]  David C. Knill,et al.  Introduction: a Bayesian formulation of visual perception , 1996 .

[53]  Sally Andrews,et al.  Frequency and neighborhood effects on lexical access: Lexical similarity or orthographic redundancy? , 1992 .

[54]  J. Raaijmakers,et al.  Testing the counter model for perceptual identification: Effects of repetition priming and word frequency , 2000, Psychonomic bulletin & review.

[55]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[56]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[57]  S. Lupker,et al.  Does jugde activate COURT? Transposed-letter similarity effects in masked associative priming , 2003, Memory & cognition.

[58]  Michael C. Doyle,et al.  Effects of frequency on visual word recognition tasks: where are they? , 1989, Journal of experimental psychology. General.

[59]  S. Lupker,et al.  Sequential effects in naming: a time-criterion account. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[60]  G. Legge,et al.  Mr. Chips: an ideal-observer model of reading. , 1997, Psychological review.

[61]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[62]  R. Ratcliff,et al.  A retrieval theory of priming in memory. , 1988, Psychological review.

[63]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[64]  D. Balota,et al.  Factors influencing word naming in younger and older adults. , 2000, Psychology and aging.

[65]  A. Jacobs,et al.  Testing a semistochastic variant of the interactive activation model in different word recognition experiments. , 1992, Journal of experimental psychology. Human perception and performance.

[66]  D. Massaro,et al.  Integration of featural information in speech perception. , 1978, Psychological review.

[67]  S. Lupker,et al.  Strategic Control in a Naming Task: Changing Routes or Changing Deadlines? , 1997 .

[68]  S. Andrews Frequency and neighborhood effects on lexical access: Activation or search? , 1989 .

[69]  Hans Stadthagen-Gonzalez,et al.  Age-of-acquisition effects in visual word recognition: evidence from expert vocabularies , 2004, Cognition.

[70]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[71]  Ridker Pm,et al.  C-reactive protein and risks of future myocardial infarction and thrombotic stroke. , 1998 .

[72]  A Pollatsek,et al.  The effects of "neighborhood size" in reading and lexical decision. , 1999, Journal of experimental psychology. Human perception and performance.

[73]  S. Lupker,et al.  Can CANISO activate CASINO? Transposed-letter similarity effects with nonadjacent letter positions ☆ , 2004 .

[74]  David C. Plaut,et al.  Structure and Function in the Lexical System: Insights from Distributed Models of Word Reading and Lexical Decision , 1997 .

[75]  N. Chater,et al.  Rational models of cognition , 1998 .

[76]  Roger Ratcliff,et al.  Modeling the effects of repetition and word frequency in perceptual identification , 2000, Psychonomic bulletin & review.

[77]  K. Fernow New York , 1896, American Potato Journal.

[78]  Barbara J. Juhasz,et al.  Age-of-acquisition effects in word and picture identification. , 2005, Psychological bulletin.

[79]  G. M. Reicher Perceptual recognition as a function of meaninfulness of stimulus material. , 1969, Journal of experimental psychology.

[80]  R. Shillcock,et al.  Low-level predictive inference in reading: the influence of transitional probabilities on eye movements , 2003, Vision Research.

[81]  Kenneth I Forster,et al.  Cascaded versus noncascaded models of lexical and semantic processing: Theturple effect , 2002, Memory & cognition.

[82]  H. Rubenstein,et al.  Homographic entries in the internal lexicon , 1970 .

[83]  L. Havens,et al.  The effect of competition on visual duration threshold and its independence of stimulus frequency. , 1963, Journal of experimental psychology.

[84]  G. Humphreys,et al.  Basic processes in reading : visual word recognition , 1993 .

[85]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[86]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[87]  Paul D. Siakaluk,et al.  Orthographic neighborhood effects in lexical decision: the effects of nonword orthographic neighborhood size. , 2002, Journal of experimental psychology. Human perception and performance.

[88]  Irwin Pollack,et al.  Analysis of Incorrect Responses to an Unknown Message Set , 1960 .

[89]  K. Forster,et al.  Lexical Access and Naming Time. , 1973 .

[90]  D. Rumelhart,et al.  Process of recognizing tachistoscopically presented words. , 1974, Psychological review.

[91]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[92]  Manuel Perea,et al.  The effects of orthographic neighborhood in reading and laboratory word identification tasks: A review , 2000 .

[93]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[94]  Michel Treisman,et al.  Space or lexicon? The word frequency effect and the error response frequency effect , 1978 .

[95]  R. Shiffrin,et al.  A model for evidence accumulation in the lexical decision task , 2004, Cognitive Psychology.

[96]  A. Salasoo,et al.  Building permanent memory codes: codification and repetition effects in word identification. , 1985, Journal of experimental psychology. General.

[97]  Andrew W. Ellis,et al.  ROLES OF WORD FREQUENCY AND AGE OF ACQUISITION IN WORD NAMING AND LEXICAL DECISION , 1995 .

[98]  N. Smelser,et al.  International Encyclopedia of the Social and Behavioral Sciences , 2001 .

[99]  M. Taft,et al.  Exploring the cohort model of spoken word recognition , 1986, Cognition.

[100]  R. Shillcock,et al.  Eye Movements Reveal the On-Line Computation of Lexical Probabilities During Reading , 2003, Psychological science.

[101]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[102]  H. Savin Word‐Frequency Effect and Errors in the Perception of Speech , 1963 .

[103]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[104]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[105]  Catriona M. Morrison,et al.  Age of acquisition, not word frequency, affects object naming, not object recognition , 1992, Memory & cognition.

[106]  Michael Garman,et al.  Psycholinguistics: Accessing the mental lexicon , 1990 .

[107]  M. Glanzer,et al.  List composition effects in lexical decision and recognition memory , 1988 .

[108]  C. L. Mallows,et al.  Individual Choice Behaviour. , 1961 .

[109]  D. Norris A quantitative multiple-levels model of reading aloud. , 1994 .

[110]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[111]  W. Geisler Ideal Observer Analysis , 2002 .

[112]  S. Andrews The effect of orthographic similarity on lexical retrieval: Resolving neighborhood conflicts , 1997 .

[113]  Roger W. Schvaneveldt,et al.  Frequency and pronounceability in visually presented naming and lexical decision tasks. , 1987 .

[114]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[115]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[116]  Kenneth I. Forster,et al.  No enemies in the neighborhood: absence of inhibitory neighborhood effects in lexical decision and semantic categorization. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[117]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[118]  Broadbent De Word-frequency effect and response bias. , 1967 .

[119]  R. Shillcock,et al.  Proceedings of the Twenty-Sixth Annual Conference of the Cognitive Science Society , 1998 .

[120]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[121]  Arthur F. Kramer,et al.  Strategies and automaticity. I: Basic findings and conceptual framework , 1994 .

[122]  R. Solomon,et al.  Visual duration threshold as a function of word-probability. , 1951, Journal of experimental psychology.

[123]  Diane Pecher,et al.  Enemies and friends in the neighborhood: orthographic similarity effects in semantic categorization. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[124]  Matthew W. Crocker,et al.  Mechanisms for Sentence Processing , 1996 .

[125]  Max Coltheart,et al.  Cross-task strategic effects , 2003, Memory & cognition.

[126]  Hedderik van Rijn,et al.  Modeling Lexical Decision as Ordinary Retrieval , 2003 .

[127]  J. Duncan An adaptive coding model of neural function in prefrontal cortex , 2001 .

[128]  K. Rayner,et al.  Comparing naming, lexical decision, and eye fixation times: Word frequency effects and individual differences , 1998, Memory & cognition.

[129]  David A. Balota Comprehension Processes in Reading. , 1990 .

[130]  A. Pollatsek,et al.  The effects of neighborhood frequency in reading and lexical decision. , 1998, Journal of experimental psychology. Human perception and performance.

[131]  Susan D. Lima,et al.  Orthographic neighborhood structure and lexical access , 1996 .

[132]  J. Mullennix,et al.  Word familiarity and frequency in visual and auditory word recognition. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[133]  K. Rayner,et al.  Parafoveal word processing during eye fixations in reading: Effects of word frequency , 1986, Perception & psychophysics.

[134]  A. Lecours,et al.  Educational level and the word frequency effect: A lexical decision investigation , 1992, Brain and Language.

[135]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[136]  H. Rubenstein,et al.  Evidence for phonemic recoding in visual word recognition , 1971 .

[137]  Robin K. Morris,et al.  Learning new word meanings from context: a study of eye movements. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[138]  S. M. Chambers Letter and order information in lexical access , 1979 .

[139]  M. Tanenhaus,et al.  Time Course of Frequency Effects in Spoken-Word Recognition: Evidence from Eye Movements , 2001, Cognitive Psychology.

[140]  Denis G. Pelli,et al.  The remarkable inefficiency of word recognition , 2003, Nature.

[141]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[142]  Mark S. Seidenberg,et al.  Age-of-acquisition effects in reading aloud: Tests of cumulative frequency and frequency trajectory , 2004, Memory & cognition.

[143]  K. Forster,et al.  Criterion bias and search sequence bias in word recognition , 1981, Memory & cognition.

[144]  John R. Anderson The Adaptive Character of Thought , 1990 .

[145]  N. F. Johnson,et al.  A Cohort Model of Visual Word Recognition , 1994, Cognitive Psychology.

[146]  Michael C. Mozer,et al.  Control of Response Initiation: Mechanisms of Adaptation to Recent Experience , 2004 .

[147]  J G Snodgrass,et al.  Neighborhood effects in visual word recognition: Facilitatory or inhibitory? , 1993, Memory & cognition.

[148]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[149]  T. McNamara Priming and constraints it places on theories of memory and retrieval , 1992 .

[150]  S. Lupker,et al.  Orthographic neighborhood effects in perceptual identification and semantic categorization tasks: A test of the multiple read-out model , 1999, Perception & psychophysics.

[151]  Martin J. Pickering,et al.  The rational of analysis of inquiry: The case of parsing. , 1998 .

[152]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[153]  Kenneth I. Forster,et al.  Frequency blocking and lexical access: One mental lexicon or two? , 1981 .

[154]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[155]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[156]  Marie-Josèphe Tainturier,et al.  Aging and the word frequency effect: A lexical decision investigation , 1989, Neuropsychologia.

[157]  Wigdor Bt,et al.  Psychology of aging. , 1967 .

[158]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[159]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[160]  J. Grainger,et al.  Effects of orthographic neighborhood in visual word recognition: cross-task comparisons. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[161]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[162]  S. Hecht,et al.  ENERGY, QUANTA, AND VISION , 1942, The Journal of general physiology.

[163]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[164]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.