Neural mechanisms underlying the grouping effect in short‐term memory

Dividing auditory sequence into groups, or imposing rhythmic, tonal, or spatial structure during presentation, improves recall performance. Several competing computational models have been proposed to account for these effects, but little is known about the neural correlates of grouping and hence the representations that encode grouped sequences. The present study used functional magnetic resonance imaging (fMRI) to compare the auditory encoding of grouped and ungrouped lists of sub‐span (six letters) and supra‐span (nine letters) length in an immediate serial recall (ISR) task. Analysis of activation revealed an extensive premotor and prefrontal network, which was significantly less active when short‐term memory (STM) span was exceeded during encoding. Only primary auditory cortex showed an increase in activation when memory span was exceeded. Comparison of activation for grouped and ungrouped lists showed that during the subspan phase bilateral planum temporale showed less activation for grouped stimuli, while during the supra‐span phase supramarginal and inferior parietal areas were more active for grouped lists. The magnitude of both temporal and parietal activations predicted enhanced recall of grouped lists. Thus neural signatures of grouping seem to reflect more structured processing in parietal areas instead of reliance on perceptual‐auditory processing in temporal regions. Hum Brain Mapp, 2011. © 2011 Wiley‐Liss, Inc.

[1]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[2]  Clive Frankish,et al.  Modality-specific grouping effects in short-term memory , 1985 .

[3]  Donald E. Broadbent,et al.  Articulatory suppression and the grouping of successive stimuli , 1981 .

[4]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[5]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[6]  Clive Frankish,et al.  Perceptual organization and precategorical acoustic storage. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[7]  D. A. Brodie,et al.  Effect of Presentation Time on Nominal and Functional Serial-Position Curves of Free Recall. , 1977 .

[8]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[9]  J Ryan,et al.  Grouping and Short-Term Memory: Different Means and Patterns of Grouping , 1969, The Quarterly journal of experimental psychology.

[10]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[11]  E. E. Smith,et al.  Working memory for order information: Multiple cognitive and neural mechanisms , 2006, Neuroscience.

[12]  C. Price,et al.  The role of the posterior superior temporal sulcus in audiovisual processing. , 2008, Cerebral cortex.

[13]  S. Bookheimer,et al.  Dissociating Neural Mechanisms of Temporal Sequencing and Processing Phonemes , 2003, Neuron.

[14]  Henry F. Adams,et al.  A note on the effect of rhythm on memory. , 1915 .

[15]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[16]  Hans Forssberg,et al.  Phonological working memory with auditory presentation of pseudo-words — An event related fMRI Study , 2008, Brain Research.

[17]  P. Horst The difficulty of multiple choice test item alternatives. , 1932 .

[18]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[19]  N. Burgess,et al.  Temporal Grouping Effects in Immediate Recall: A Working Memory Analysis , 1996 .

[20]  Kenneth I Forster,et al.  DMDX: A Windows display program with millisecond accuracy , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[21]  Daniel J. Mitchell,et al.  Flexible, capacity-limited activity of posterior parietal cortex in perceptual as well as visual short-term memory tasks. , 2008, Cerebral cortex.

[22]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[23]  Bradley R. Buchsbaum,et al.  Reading, hearing, and the planum temporale , 2005, NeuroImage.

[24]  Chris Rorden,et al.  Temporal Order Processing of Syllables in the Left Parietal Lobe , 2009, The Journal of Neuroscience.

[25]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[26]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[27]  Karl J. Friston,et al.  Nonlinear Coupling between Evoked rCBF and BOLD Signals: A Simulation Study of Hemodynamic Responses , 2001, NeuroImage.

[28]  Rna Henson,et al.  Short-term memory for serial order. , 2001 .

[29]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[30]  T. Griffiths,et al.  The planum temporale as a computational hub , 2002, Trends in Neurosciences.

[31]  Bradley R. Buchsbaum,et al.  The Search for the Phonological Store: From Loop to Convolution , 2008, Journal of Cognitive Neuroscience.

[32]  J. Jahnke Presentation rate and the serial-position effect of immediate serial recall , 1968 .

[33]  Ryozo Yoshino,et al.  MAGICAL NUMBERS OF HUMAN SHORT-TERM MEMORY—EFFICIENT DESIGNS OF BIOLOGICAL MEMORY SYSTEMS?— , 1993 .

[34]  Dennis Norris,et al.  Automated post‐hoc noise cancellation tool for audio recordings acquired in an MRI scanner , 2005, Human brain mapping.

[35]  N. Burgess,et al.  A revised model of short-term memory and long-term learning of verbal sequences , 2006 .

[36]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[37]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[38]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[39]  David Corina,et al.  The roles of human lateral temporal cortical neuronal activity in recent verbal memory encoding. , 2009, Cerebral cortex.

[40]  J. Duncan,et al.  Encoding Strategies Dissociate Prefrontal Activity from Working Memory Demand , 2003, Neuron.

[41]  R. Henson Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[42]  J. Jonides,et al.  Working memory for order and the parietal cortex: An event-related functional magnetic resonance imaging study , 2006, Neuroscience.

[43]  J. MacGregor Short-term memory capacity: Limitation or optimization? , 1987 .

[44]  W. A. Wickelgren,et al.  SIZE OF REHEARSAL GROUP AND SHORT-TERM MEMORY. , 1964, Journal of experimental psychology.

[45]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[46]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[47]  J. Rauschecker,et al.  Multiple stages of auditory speech perception reflected in event-related FMRI. , 2007, Cerebral cortex.

[48]  Kevin G. Munhall,et al.  Functional Overlap between Regions Involved in Speech Perception and in Monitoring One's Own Voice during Speech Production , 2010, Journal of Cognitive Neuroscience.

[49]  K. Berman,et al.  Human Dorsal and Ventral Auditory Streams Subserve Rehearsal-Based and Echoic Processes during Verbal Working Memory , 2005, Neuron.

[50]  R. Henson,et al.  Frontal lobes and human memory: insights from functional neuroimaging. , 2001, Brain : a journal of neurology.

[51]  Richard N. Henson,et al.  CHAPTER 15 – Efficient Experimental Design for fMRI , 2007 .

[52]  J. Fiez,et al.  Functional Magnetic Resonance Imaging (fmri) Was Used to Investigate the Neural Substrates of Component Processes in Verbal Working Memory. Based on Behavioral Research Using , 2022 .

[53]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[54]  W. Edmister,et al.  Nonlinearity of FMRI responses in human auditory cortex , 2004, Human brain mapping.

[55]  J. Desmond,et al.  Load-Dependent Roles of Frontal Brain Regions in the Maintenance of Working Memory , 1999, NeuroImage.