Neural dynamics of variable-rate speech categorization.

What is the neural representation of a speech code as it evolves in time? A neural model simulates data concerning segregation and integration of phonetic percepts. Hearing two phonetically related stops in a VC-CV pair (V = vowel; C = consonant) requires 150 ms more closure time than hearing two phonetically different stops in a VC1-C2V pair. Closure time also varies with long-term stimulus rate. The model simulates rate-dependent category boundaries that emerge from feedback interactions between a working memory for short-term storage of phonetic items and a list categorization network for grouping sequences of items. The conscious speech code is a resonant wave. It emerges after bottom-up signals from the working memory select list chunks which read out top-down expectations that amplify and focus attention on consistent working memory items. In VC1-C2V pairs, resonance is reset by mismatch of C2 with the C1 expectation. In VC-CV pairs, resonance prolongs a repeated C.

[1]  Geo. M. Hopkins.  Some Experiments in Sound , 1889 .

[2]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[3]  L. R. Decker,et al.  Time Factors in Perception of A Double Consonant , 1960 .

[4]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[5]  S. Grossberg,et al.  Some physiological and biochemical consequences of psychological postulates. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[6]  S. Grossberg.  On the production and release of chemical transmitters and related topics in cellular control. , 1969, Journal of theoretical biology.

[7]  Stephen Grossberg,et al.  A Neural Theory of Punishment and Avoidance, II: Quantitative Theory , 1972 .

[8]  Stephen Grossberg,et al.  Contour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks , 1973 .

[9]  S. Grossberg.  Contour Enhancement , Short Term Memory , and Constancies in Reverberating Neural Networks , 1973 .

[10]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[11]  R. M. Warren,et al.  Phonemic restorations based on subsequent context , 1974 .

[12]  W. Kintsch,et al.  Memory and cognition , 1977 .

[13]  B H Repp,et al.  Perceptual integration of acoustic cues for stop, fricative, and affricate manner. , 1978, Journal of experimental psychology. Human perception and performance.

[14]  B. Repp.  Perceptual integration and differentiation of spectral cues for intervocalic stop consonants , 1978, Perception & psychophysics.

[15]  S. Grossberg.  Behavioral Contrast in Short Term Memory: Serial Binary Memory Models or Parallel Continuous Memory Models? , 1978 .

[16]  A. Liberman,et al.  Some experiments on the sound of silence in phonetic perception. , 1979, The Journal of the Acoustical Society of America.

[17]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[18]  Roger W. Schvaneveldt,et al.  Semantic Context and the Encoding of Words: Evidence for Two Modes of Stimulus Analysis. , 1981 .

[19]  A. Samuel.  Phonemic restoration: insights from a new methodology. , 1981, Journal of experimental psychology. General.

[20]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[21]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[22]  J. Pickles.  An Introduction to the Physiology of Hearing , 1982 .

[23]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[24]  J. C. Johnston,et al.  Length effects in word perception: we is better than i but worse than you or them. , 1982, Journal of experimental psychology. Human perception and performance.

[25]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[26]  S. Grossberg,et al.  A neural theory of circadian rhythms: Aschoff's rule in diurnal and nocturnal mammals. , 1984, The American journal of physiology.

[27]  R M Warren,et al.  Perceptual restoration of obliterated sounds. , 1984, Psychological bulletin.

[28]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[29]  James L. McClelland.  Putting Knowledge in its Place: A Scheme for Programming Parallel Processing Structures on the Fly , 1988, Cogn. Sci..

[30]  S. Grossberg,et al.  A neural theory of circadian rhythms: split rhythms, after-effects and motivational interactions. , 1985, Journal of theoretical biology.

[31]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[32]  Stephen Grossberg,et al.  CHAPTER 6 – The Adaptive Self-organization of Serial Order in Behavior: Speech, Language, and Motor Control* , 1986 .

[33]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[34]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control , 1986 .

[35]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control : ballistic eye movements , 1986 .

[36]  R. Schmidt,et al.  Progress in Sensory Physiology 6 , 1986, Progress in Sensory Physiology.

[37]  Eileen C. Schwab,et al.  Pattern recognition by humans and machines , 1986 .

[38]  S. Grossberg,et al.  Neural dynamics of attention switching and temporal-order information in short-term memory , 1988, Memory & cognition.

[39]  S. Grossberg,et al.  A neural theory of circadian rhythms: Aschoff's rule in diurnal and nocturnal mammals , 1987 .

[40]  Stephen Grossberg,et al.  From Interactive Activation to Adaptive Resonance , 1987 .

[41]  S. Grossberg.  The Adaptive Self-Organization of Serial Order in Behavior: Speech, Language, And Motor Control , 1987 .

[42]  R. Mccarthy.  Working Memory. (Oxford Psychology Series No. 11.) , 1987 .

[43]  Stephen Grossberg,et al.  Speech Perception and Production by a Self-Organizing Neural Network. , 1987 .

[44]  S Grossberg,et al.  Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. , 1987, Applied optics.

[45]  Stephen Grossberg,et al.  Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. , 1986, Psychology Review.

[46]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[47]  R. M. Warren,et al.  Multiple phonemic restorations follow the rules for auditory induction , 1987, Perception & psychophysics.

[48]  Stephen Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[49]  B. Repp.  Integration and Segregation in Speech Perception , 1988, Language and speech.

[50]  Y. C. Lee,et al.  Evolution, Learning And Cognition , 1988 .

[51]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[52]  S. Grossberg.  How does the brain build a cognitive code , 1988 .

[53]  D. Massaro.  Testing between the TRACE model and the fuzzy logical model of speech perception , 1989, Cognitive Psychology.

[54]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[55]  Joanne L. Miller,et al.  Speech Perception , 1990, Springer Handbook of Auditory Research.

[56]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[57]  R. Schmidt,et al.  Progress in Sensory Physiology , 1991, Progress in Sensory Physiology.

[58]  Daniel Bullock,et al.  A neural network model of serial order recall from short-term memory , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[59]  D. Massaro,et al.  Integration versus interactive activation: The joint influence of stimulus and context in perception , 1991, Cognitive Psychology.

[60]  Stephen Grossberg,et al.  Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories , 1991, Neural Networks.

[61]  Stephen Grossberg,et al.  Working Memory Networks for Learning Temporal Order with Application to Three-Dimensional Visual Object Recognition , 1992, Neural Computation.

[62]  S. Grossberg,et al.  A self-organizing neural network for supervised learning, recognition, and prediction , 1992, IEEE Communications Magazine.

[63]  J. Cutting,et al.  Selectivity, scope, and simplicity of models: a lesson from fitting judgments of perceived depth. , 1992, Journal of experimental psychology. General.

[64]  D. Massaro,et al.  The paradigm and the fuzzy logical model of perception are alive and well. , 1993, Journal of experimental psychology. General.

[65]  Stephen Grossberg,et al.  Integrating Symbolic and Neural Processing in a Self-Organizing Architechture for Pattern Recognition and Prediction , 1993 .

[66]  S. Grossberg,et al.  Normal and amnesic learning, recognition and memory by a neural model of cortico-hippocampal interactions , 1993, Trends in Neurosciences.

[67]  Stephen Grossberg,et al.  A Neural Network Architecture for Autonomous Learning, Recognition, and Prediction in a Nonstationary World , 1993 .

[68]  Stephen Grossberg,et al.  Variable Rate Working Memories for Phonetic Categorization and Invariant Speech Perception , 1993 .

[69]  Influence of silence duration distribution in perception of stop consonant clusters , 1994 .

[70]  S. Grossberg,et al.  Cortical dynamics of feature binding and reset: Control of visual persistence , 1994, Vision Research.

[71]  Riccardo Rossetti.  Gemination of Italian stops , 1994 .

[72]  Stephen Grossberg,et al.  A Neural Network Model of Auditory Scene Anaysis and Source Segregation , 1994 .

[73]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[74]  D W Massaro,et al.  Independence of lexical context and phonological information in speech perception. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[75]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[76]  Jonathan Baxter,et al.  Learning internal representations , 1995, COLT '95.

[77]  M A Pitt.  Data fitting and detection theory: reply to Massaro and Oden (1995). , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[78]  M. Pitt.  The locus of the lexical shift in phoneme identification. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[79]  S. Grossberg.  The Attentive Brain , 1995 .

[80]  S. Grossberg,et al.  Cortical dynamics of form and motion integration: Persistence, apparent motion, and illusory contours , 1996, Vision Research.

[81]  S. Grossberg,et al.  Cortical Dynamics of Boundary Segmentation and Reset: Persistence, Afterimages, and Residual Traces , 1996, Perception.

[82]  R. Parasuraman.  The attentive brain , 1998 .