Sequence Encoders Enable Large-Scale Lexical Modeling: Reply to Bowers and Davis (2009)

Sibley, Kello, Plaut, and Elman (2008) proposed the sequence encoder as a model that learns fixed-width distributed representations of variable-length sequences. In doing so, the sequence encoder overcomes problems that have restricted models of word reading and recognition to processing only monosyllabic words. Bowers and Davis (in press) recently claimed that the sequence encoder does not actually overcome the relevant problems, and hence is not a useful component of large-scale word reading models. In this reply, it is noted that the sequence encoder has facilitated the creation of large-scale word reading models. The reasons for this success are explained, and stand as counterarguments to claims made by Bowers and Davis.

[1]  Jeffrey L. Elman,et al.  Large-Scale Modeling of Wordform Learning and Representation , 2008, Cogn. Sci..

[2]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[3]  Jeffrey S. Bowers,et al.  Learning Representations of Wordforms With Recurrent Networks: Comment on , 2009, Cogn. Sci..

[4]  Daragh E. Sibley,et al.  Learning orthographic and phonological representations in models of monosyllabic and bisyllabic naming , 2010 .

[5]  Sally Andrews,et al.  From inkmarks to ideas : current issues in lexical processing , 2006 .

[6]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[7]  Marco Zorzi,et al.  Nested incremental modeling in the development of computational theories: the CDP+ model of reading aloud. , 2007, Psychological review.

[8]  B. Ans,et al.  A connectionist multiple-trace memory model for polysyllabic word reading. , 1998, Psychological review.

[9]  G. Miller,et al.  Cognitive science. , 1981, Science.

[10]  Christopher T. Kello,et al.  1 Considering the Junction Model of Lexical Processing , 2022 .

[11]  Daragh E. Sibley,et al.  Large scale modeling of single word reading and recognition A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2008 .

[12]  Jeffrey R. Binder,et al.  Tuning of the human left fusiform gyrus to sublexical orthographic structure , 2006, NeuroImage.

[13]  Jonathan Grainger,et al.  Letter position information and printed word perception: the relative-position priming constraint. , 2006, Journal of experimental psychology. Human perception and performance.

[14]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[15]  Colin J. Davis,et al.  The self-organising lexical acquisition and recognition (SOLAR) model of visual word recognition. , 2001 .