Scanning acoustic short-term memory: Evidences for two subsystems with different time-course and memory strength.

We studied the cognitive processes involved in pure acoustic memory retrieval using ERPs and independent component analysis (ICA) of the ERPs. We used a modified Sternberg task with pure tones as memory items, with 3 memory set size conditions (2, 4, or 6 tones), and a control condition in which no task-relevant tone was presented (tones replaced by white-noise segments). Participants reported the presence or absence of a probe tone in the memory set. EEG signals were recorded using a BioSemi ActiveTwo system, with 64 active electrodes following the 10-10 system and average-mastoids reference. A P3 component, at electrode POz, was elicited by the probe when items were to be held in memory, no P3 was observed in control trials. With an increase in memory load, P3 amplitude decreased, accuracy was lower, and response time (RT) longer. There was a clear recency effect, in the electrophysiological and behavioral results reflected in a larger P3, shorter RT, and higher accuracy, when the probe matched the last tone of a sequence than when it matched any of the other presented tones, regardless of memory load. P3 amplitude and behavioral results were similar across all the other serial positions and loads. The results suggest that acoustic memory for pure tones is mediated by two subsystems: one encoding the last item with high probability, and another for all other serial positions. ICA of the ERPs isolated parieto-occipital ICA components with larger activations for probes that matched the last serial position than for earlier ones, and an anterior component that had little activation for the last serial positions and large activations for all earlier ones, corroborating the two-systems theory.

[1]  Lutz Jäncke,et al.  Functional anatomy of pitch memory—an fMRI study with sparse temporal sampling , 2003, NeuroImage.

[2]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[3]  P. Jolicœur,et al.  Memory for pure tone sequences without contour , 2016, Brain Research.

[4]  W. Velicer,et al.  The Effects of Overextraction on Factor and Component Analysis. , 1992, Multivariate behavioral research.

[5]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[6]  L. McEvoy,et al.  Temporal characteristics of auditory sensory memory: neuromagnetic evidence. , 1997, Psychophysiology.

[7]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[8]  Stephan Grimault,et al.  The retention of simultaneous tones in auditory short-term memory: A magnetoencephalography study , 2013, NeuroImage.

[9]  S. Glucksberg,et al.  Memory for nonattended auditory material , 1970 .

[10]  L D Blumhardt,et al.  Wave form variations in auditory event-related potentials evoked by a memory-scanning task and their relationship with tests of intellectual function. , 1992, Electroencephalography and clinical neurophysiology.

[11]  R. Nosofsky,et al.  The structure of short-term memory scanning: an investigation using response time distribution models , 2012, Psychonomic Bulletin & Review.

[12]  H Pratt,et al.  Event-related potential correlates of the serial position effect in short-term memory. , 1991, Electroencephalography and clinical neurophysiology.

[13]  K. Müller,et al.  Functional architecture of verbal and tonal working memory: An FMRI study , 2009, Human brain mapping.

[14]  S. Monsell Recency, immediate recognition memory, and reaction time , 1978, Cognitive Psychology.

[15]  M. Corballis Serial order in recognition and recall. , 1967, Journal of experimental psychology.

[16]  C. Clifton,et al.  Effects of serial position and delay of probe in a memory scan task. , 1970 .

[17]  Alan C. Evans,et al.  Neural mechanisms underlying melodic perception and memory for pitch , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[19]  A Pfefferbaum,et al.  P300 and long-term memory: latency predicts recognition performance. , 1985, Psychophysiology.

[20]  M. Corballis,et al.  Access to elements of a memorized list , 1972 .

[21]  Edward J. Golob,et al.  Serial Position Effects in Auditory Event-related Potentials during Working Memory Retrieval , 2004, Journal of Cognitive Neuroscience.

[22]  Arnaud Delorme,et al.  Applying dimension reduction to EEG data by Principal Component Analysis reduces the quality of its subsequent Independent Component decomposition , 2018, NeuroImage.

[23]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[24]  R. Verleger On the utility of P3 latency as an index of mental chronometry. , 1997, Psychophysiology.

[25]  R. G. Crowder,et al.  Precategorical acoustic storage (PAS) , 1969 .

[26]  Sandra E. Trehub,et al.  Infants' and adults' perception of scale structure. , 1999 .

[27]  P. Jolicoeur,et al.  A Solution to the Effect of Sample Size on Outlier Elimination , 1994 .

[28]  H Pratt,et al.  Brain potentials in a memory-scanning task. I. Modality and task effects on potentials to the probes. , 1989, Electroencephalography and clinical neurophysiology.

[29]  Isabelle Peretz,et al.  Brain activity is related to individual differences in the number of items stored in auditory short-term memory for pitch: Evidence from magnetoencephalography , 2014, NeuroImage.

[30]  Tzyy-Ping Jung,et al.  Imaging brain dynamics using independent component analysis , 2001, Proc. IEEE.

[31]  M. Laine,et al.  Event-related EEG desynchronization and synchronization during an auditory memory task. , 1996, Electroencephalography and clinical neurophysiology.

[32]  N. Adam,et al.  Late components of the visual evoked potential to search in short-term memory. , 1978, Electroencephalography and clinical neurophysiology.

[33]  Pierre Jolicoeur,et al.  The Attentional Blink Impairs Detection and Delays Encoding of Visual Information: Evidence from Human Electrophysiology , 2015, Journal of Cognitive Neuroscience.

[34]  J. Ford,et al.  Event-related potentials recorded from young and old adults during a memory retrieval task. , 1979, Electroencephalography and clinical neurophysiology.

[35]  P. Dux,et al.  Enhanced frontal activation underlies sparing from the attentional blink: Evidence from human electrophysiology. , 2016, Psychophysiology.

[36]  N. Cowan,et al.  The role of absolute and relative amounts of time in forgetting within immediate memory: The case of tone-pitch comparisons , 1997 .

[37]  L D Blumhardt,et al.  Which event-related potentials reflect memory processing in a digit-probe identification task? , 1998, Brain research. Cognitive brain research.

[38]  Isabelle Peretz,et al.  Distinct electrophysiological indices of maintenance in auditory and visual short-term memory , 2013, Neuropsychologia.

[39]  How long does the modality effect persist , 1982 .

[40]  Brandi Lee Drisdelle,et al.  Dealing with ocular artifacts on lateralized ERPs in studies of visual-spatial attention and memory: ICA correction versus epoch rejection. , 2017, Psychophysiology.

[41]  R. Knight,et al.  Prefrontal and posterior cortical activation during auditory working memory. , 1996, Brain research. Cognitive brain research.

[42]  A. Engel,et al.  What is novel in the novelty oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis. , 2005, Brain research. Cognitive brain research.

[43]  István Winkler,et al.  Processing abstract auditory features in the human auditory cortex , 2003, NeuroImage.

[44]  Mark H. Johnson,et al.  Recording and Analyzing High-Density Event-Related Potentials With Infants Using the Geodesic Sensor Net , 2001, Developmental neuropsychology.

[45]  R. G. Crowder Principles of learning and memory , 1977 .

[46]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[47]  N. Cowan On short and long auditory stores. , 1984, Psychological bulletin.

[48]  Steven A. Hillyard,et al.  Decision-related cortical potentials during an auditory signal detection task with cued observation intervals , 1975 .

[49]  I. Winkler,et al.  Memory prerequisites of mismatch negativity in the auditory event-related potential (ERP). , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[50]  J. Morton,et al.  Experiments with the stimulus suffix effect. , 1971, Journal of experimental psychology.

[51]  William E. Hockley,et al.  Tests of serial scanning in item recognition. , 1982 .

[52]  T. Ferrée,et al.  Spherical Splines and Average Referencing in Scalp Electroencephalography , 2006, Brain Topography.

[53]  P. Berg,et al.  Optimizing principal components analysis of event-related potentials: Matrix type, factor loading weighting, extraction, and rotations , 2005, Clinical Neurophysiology.

[54]  Saul Sternberg,et al.  In Defence of High-Speed Memory Scanning , 2016, Quarterly journal of experimental psychology.

[55]  P. Jolicoeur,et al.  Electrophysiological correlates of the retention of tones differing in timbre in auditory short-term memory , 2013, Neuropsychologia.

[56]  S. Sternberg Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[57]  B. Murdock A parallel-processing model for scanning , 1971 .

[58]  S. Sternberg High-Speed Scanning in Human Memory , 1966, Science.

[59]  P. Jolicoeur,et al.  Electrophysiological correlates of the maintenance of the representation of pitch objects in acoustic short-term memory. , 2011, Psychophysiology.

[60]  Richard C. Atkinson,et al.  Search and decision processes in recognition memory. , 1974 .

[61]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[62]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[63]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[64]  A. Starr,et al.  Disordered auditory short-term memory in man and event-related potentials. , 1987, Brain : a journal of neurology.

[65]  Wayne F. Velicer,et al.  The Effects of Underextraction in Factor and Component Analyses , 1996 .

[66]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[67]  Joseph Dien,et al.  Applying Principal Components Analysis to Event-Related Potentials: A Tutorial , 2012, Developmental neuropsychology.

[68]  I. Winkler,et al.  From sensory to long-term memory: evidence from auditory memory reactivation studies. , 2005, Experimental psychology.

[69]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[70]  L. Romanski,et al.  Neural circuits in auditory and audiovisual memory , 2016, Brain Research.

[71]  Ronald Okada,et al.  Serial position effects in high-speed memory search , 1971 .

[72]  John H. Robinson,et al.  P300 and Response Selection: A New Look Using Independent-Components Analysis , 2004, Brain Topography.

[73]  Julie A Fiez,et al.  Functional dissociations within the inferior parietal cortex in verbal working memory , 2004, NeuroImage.

[74]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[75]  G. Karmos,et al.  Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential , 1996, Brain Research.

[76]  R. Verleger,et al.  P3 latency shifts in the attentional blink: Further evidence for second target processing postponement , 2007, Brain Research.

[77]  C. Tenke,et al.  Optimizing PCA methodology for ERP component identification and measurement: theoretical rationale and empirical evaluation , 2003, Clinical Neurophysiology.

[78]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.