Distinct Effects of Perceptual Quality on Auditory Word Recognition, Memory Formation and Recall in a Neural Model of Sequential Memory

Adults with sensory impairment, such as reduced hearing acuity, have impaired ability to recall identifiable words, even when their memory is otherwise normal. We hypothesize that poorer stimulus quality causes weaker activity in neurons responsive to the stimulus and more time to elapse between stimulus onset and identification. The weaker activity and increased delay to stimulus identification reduce the necessary strengthening of connections between neurons active before stimulus presentation and neurons active at the time of stimulus identification. We test our hypothesis through a biologically motivated computational model, which performs item recognition, memory formation and memory retrieval. In our simulations, spiking neurons are distributed into pools representing either items or context, in two separate, but connected winner-takes-all (WTA) networks. We include associative, Hebbian learning, by comparing multiple forms of spike-timing-dependent plasticity (STDP), which strengthen synapses between coactive neurons during stimulus identification. Synaptic strengthening by STDP can be sufficient to reactivate neurons during recall if their activity during a prior stimulus rose strongly and rapidly. We find that a single poor quality stimulus impairs recall of neighboring stimuli as well as the weak stimulus itself. We demonstrate that within the WTA paradigm of word recognition, reactivation of separate, connected sets of non-word, context cells permits reverse recall. Also, only with such coactive context cells, does slowing the rate of stimulus presentation increase recall probability. We conclude that significant temporal overlap of neural activity patterns, absent from individual WTA networks, is necessary to match behavioral data for word recall.

[1]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[2]  O Jensen,et al.  Novel lists of 7 +/- 2 known items can be reliably stored in an oscillatory short-term memory network: interaction with long-term memory. , 1996, Learning & memory.

[3]  Michael J. Kahana,et al.  Effects of adult aging on utilization of temporal and semantic associations during free and serial recall , 2008, Memory & cognition.

[4]  Arthur Wingfield,et al.  Effects of adult aging and hearing loss on comprehension of rapid speech varying in syntactic complexity. , 2006, Journal of the American Academy of Audiology.

[5]  Thomas P. Trappenberg,et al.  Self-organizing continuous attractor networks and motor function , 2003, Neural Networks.

[6]  D. Kahneman,et al.  Attention and Effort , 1973 .

[7]  D. Amit,et al.  Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network , 2003, The European journal of neuroscience.

[8]  L. F. Abbott,et al.  A Model of Spatial Map Formation in the Hippocampus of the Rat , 1999, Neural Computation.

[9]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[10]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[11]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[12]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[13]  S. Kaplan The Physiology of Thought , 1950 .

[14]  L. Abbott,et al.  Extending the effects of spike-timing-dependent plasticity to behavioral timescales. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[15]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[16]  Wade G. Regehr,et al.  Associative Short-Term Synaptic Plasticity Mediated by Endocannabinoids , 2005, Neuron.

[17]  Marc W Howard,et al.  Contextual variability and serial position effects in free recall. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[18]  Yevgeniy B. Sirotin,et al.  Temporal associations and prior-list intrusions in free recall. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[19]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[20]  Mario Rosanova,et al.  Pattern-Specific Associative Long-Term Potentiation Induced by a Sleep Spindle-Related Spike Train , 2005, The Journal of Neuroscience.

[21]  An Exploration of the Interaction between Speech Rate, Gender, and Cognitive Style in their Effect on Recall , 2007 .

[22]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[23]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Marc W Howard,et al.  Spacing and lag effects in free recall of pure lists , 2005, Psychonomic bulletin & review.

[25]  Michael J Kahana,et al.  Age dissociates recency and lag recency effects in free recall. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[26]  L. Dobrunz,et al.  Calcium-permeable presynaptic kainate receptors involved in excitatory short-term facilitation onto somatostatin interneurons during natural stimulus patterns. , 2009, Journal of neurophysiology.

[27]  M. Kahana,et al.  Associative asymmetry in probed recall of serial lists , 2002, Memory & cognition.

[28]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[29]  Vinayak A. Rao,et al.  Bridging the gap: transitive associations between items presented in similar temporal contexts. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[30]  Bruce A Schneider,et al.  Comparing the effects of aging and background noise on short-term memory performance. , 2000, Psychology and aging.

[31]  B. Schneider,et al.  Implications of perceptual deterioration for cognitive aging research. , 2000 .

[32]  Robert C. Malenka,et al.  Postsynaptic factors control the duration of synaptic enhancement in area CA1 of the hippocampus , 1991, Neuron.

[33]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[34]  A. Surprenant,et al.  Effects of Noise on Identification and Serial Recall of Nonsense Syllables in Older and Younger Adults , 2007, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[35]  M. Kahana Associative retrieval processes in free recall , 1996, Memory & cognition.

[36]  D. Perrais,et al.  Short-Term Plasticity of Kainate Receptor-Mediated EPSCs Induced by NMDA Receptors at Hippocampal Mossy Fiber Synapses , 2007, The Journal of Neuroscience.

[37]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[38]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[39]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[40]  P. J. Sjöström,et al.  Spike timing, calcium signals and synaptic plasticity , 2002, Current Opinion in Neurobiology.

[41]  B. Connors,et al.  Short-term synaptic enhancement and long-term potentiation in neocortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[42]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[43]  S. Nelson,et al.  Hebb and homeostasis in neuronal plasticity , 2000, Current Opinion in Neurobiology.

[44]  T. Troyer,et al.  An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. , 2000, Journal of neurophysiology.

[45]  M. Bear,et al.  Elementary forms of synaptic plasticity in the visual cortex. , 1995, Biological research.

[46]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[47]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[48]  T W Troyer,et al.  An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. , 2000, Journal of neurophysiology.

[49]  P. Castillo,et al.  Interneuron activity controls endocannabinoid-mediated presynaptic plasticity through calcineurin , 2008, Proceedings of the National Academy of Sciences.

[50]  P. Rabbitt,et al.  Channel-Capacity, Intelligibility and Immediate Memory , 1968, The Quarterly journal of experimental psychology.

[51]  P. Rabbitt Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. , 1990, Acta oto-laryngologica. Supplementum.

[52]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[53]  S. Grossberg,et al.  Laminar cortical dynamics of cognitive and motor working memory, sequence learning and performance: toward a unified theory of how the cerebral cortex works. , 2008, Psychological review.

[54]  Marc W Howard,et al.  A context-based theory of recency and contiguity in free recall. , 2008, Psychological review.

[55]  T. Troyer,et al.  An Associational Model of Birdsong Sensorimotor Learning , 2000 .

[56]  Aimée M. Surprenant,et al.  The Effect of Noise on Memory for Spoken Syllables , 1999 .

[57]  A Wingfield,et al.  How much and how fast: rapid processing of spoken language in later adulthood. , 1986, Psychology and aging.

[58]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[59]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[60]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[61]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[62]  J. Larson,et al.  Theta burst stimulation is optimal for induction of LTP at both apical and basal dendritic synapses on hippocampal CA1 neurons , 1992, Brain Research.

[63]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[64]  Michael J Kahana,et al.  Aging and contextual binding: Modeling recency and lag recency effects with the temporal context model , 2006, Psychonomic bulletin & review.

[65]  Arthur Wingfield,et al.  Regaining lost time: adult aging and the effect of time restoration on recall of time-compressed speech. , 1999, Psychology and aging.

[66]  M. Hasselmo,et al.  Temporally structured replay of neural activity in a model of entorhinal cortex, hippocampus and postsubiculum , 2008, The European journal of neuroscience.

[67]  D J Amit,et al.  Multiple-object working memory--a model for behavioral performance. , 2003, Cerebral cortex.

[68]  N. Brunel Persistent activity and the single-cell frequency–current curve in a cortical network model , 2000, Network.

[69]  Thomas Nowotny,et al.  Spatial representation of temporal information through spike-timing-dependent plasticity. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[70]  Edmund T. Rolls,et al.  Learning movement sequences with a delayed reward signal in a hierarchical model of motor function , 2007, Neural Networks.

[71]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[72]  SM Dudek,et al.  Bidirectional long-term modification of synaptic effectiveness in the adult and immature hippocampus , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  Paul Miller,et al.  Stability of discrete memory states to stochastic fluctuations in neuronal systems. , 2006, Chaos.

[74]  Michael J Kahana,et al.  The dynamics of memory retrieval in older adulthood. , 2002, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[75]  P. J. Sjöström,et al.  Rate and timing in cortical synaptic plasticity. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[76]  Arthur Wingfield,et al.  Hearing Loss and Perceptual Effort: Downstream Effects on Older Adults’ Memory for Speech , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[77]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[78]  Effects of Signal Intensity on Increase of Reaction Time on an Auditory Monitoring Task , 1972, Perceptual and motor skills.

[79]  B. R. Bugelski Principles of learning and memory , 1956 .

[80]  A Wingfield,et al.  Regaining lost time: adult aging and the effect of time restoration on recall of time-compressed speech. , 1999, Psychology and aging.

[81]  Johannes J. Letzkus,et al.  DOES SPIKE TIMING‐DEPENDENT SYNAPTIC PLASTICITY UNDERLIE MEMORY FORMATION? , 2007, Clinical and experimental pharmacology & physiology.

[82]  A. Wingfield,et al.  Passage difficulty, speech rate, and age differences in memory for spoken text: speech recall and the complexity hypothesis. , 1993, Experimental aging research.

[83]  M. Kathleen Pichora-Fuller,et al.  Cognitive aging and auditory information processing , 2003, International journal of audiology.

[84]  Masahiko Watanabe,et al.  Endocannabinoid-mediated control of synaptic transmission. , 2009, Physiological reviews.

[85]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.