Item performance in visual word recognition

Standard factorial designs in psycholinguistics have been complemented recently by large-scale databases providing empirical constraints at the level of item performance. At the same time, the development of precise computational architectures has led modelers to compare item-level performance with item-level predictions. It has been suggested, however, that item performance includes a large amount of undesirable error variance that should be quantified to determine the amount of reproducible variance that models should account for. In the present study, we provide a simple and tractable statistical analysis of this issue. We also report practical solutions for estimating the amount of reproducible variance for any database that conforms to the additive decomposition of the variance. A new empirical database consisting of the word identification times of 140 participants on 120 words is then used to test these practical solutions. Finally, we show that increases in the amount of reproducible variance are accompanied by the detection of new sources of variance.

[1]  Jun Lu,et al.  An introduction to Bayesian hierarchical models with an application in the theory of signal detection , 2005, Psychonomic bulletin & review.

[2]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[3]  Arnaud Rey,et al.  Graphemic complexity and multiple print-to-sound associations in visual word recognition , 2005, Memory & cognition.

[4]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[5]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[6]  Marco Zorzi,et al.  Nested incremental modeling in the development of computational theories: the CDP+ model of reading aloud. , 2007, Psychological review.

[7]  J. D. Opdyke.  Fast Permutation Tests that Maximize Power Under Conventional Monte Carlo Sampling for Pairwise and Multiple Comparisons , 2003 .

[8]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[9]  P. Good,et al.  Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses , 1995 .

[10]  Bruno D. Zumbo,et al.  Bias in Estimation and Hypothesis Testing of Correlation , 2003 .

[11]  David C. Plaut,et al.  Evaluating Word-Reading Models at the Item Level: Matching the Grain of Theory and Data , 1998 .

[12]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[13]  David A. Balota,et al.  The Utility of Item-Level Analyses in Model Evaluation: A Reply to Seidenberg and Plaut , 1998 .

[14]  David A. Balota,et al.  Bringing Computational Models of Word Naming Down to the Item Level , 1997 .

[15]  Arnaud Rey,et al.  A phoneme effect in visual word recognition , 1998, Cognition.

[16]  B. Ans,et al.  A connectionist multiple-trace memory model for polysyllabic word reading. , 1998, Psychological review.

[17]  Mark S. Seidenberg,et al.  Computing the meanings of words in reading: cooperative division of labor between visual and phonological processes. , 2004, Psychological review.