Transmodal comparison of auditory, motor, and visual post-processing with and without intentional short-term memory maintenance

OBJECTIVE To elucidate the contributions of modality-dependent post-processing in auditory, motor and visual cortical areas to short-term memory. METHODS We compared late negative waves (N700) during the post-processing of single lateralized stimuli which were separated by long intertrial intervals across the auditory, motor and visual modalities. Tasks either required or competed with attention to post-processing of preceding events, i.e. active short-term memory maintenance. RESULTS N700 indicated that cortical post-processing exceeded short movements as well as short auditory or visual stimuli for over half a second without intentional short-term memory maintenance. Modality-specific topographies pointed towards sensory (respectively motor) generators with comparable time-courses across the different modalities. Lateralization and amplitude of auditory/motor/visual N700 were enhanced by active short-term memory maintenance compared to attention to current perceptions or passive stimulation. The memory-related N700 increase followed the characteristic time-course and modality-specific topography of the N700 without intentional memory-maintenance. CONCLUSIONS Memory-maintenance-related lateralized negative potentials may be related to a less lateralised modality-dependent post-processing N700 component which occurs also without intentional memory maintenance (automatic memory trace or effortless attraction of attention). Encoding to short-term memory may involve controlled attention to modality-dependent post-processing. SIGNIFICANCE Similar short-term memory processes may exist in the auditory, motor and visual systems.

[1]  S. Bender,et al.  The topography of the scalp-recorded visual N700 , 2008, Clinical Neurophysiology.

[2]  F. Rösler,et al.  Exploring memory functions by means of brain electrical topography: A review , 2005, Brain Topography.

[3]  Robert T Knight,et al.  Temporal kinetics of prefrontal modulation of the extrastriate cortex during visual attention , 2004, Cognitive, affective & behavioral neuroscience.

[4]  P. Goldman-Rakic.  The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  D. Linden,et al.  The Working Memory Networks of the Human Brain , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[6]  D B Lindsley,et al.  Cortical slow negative waves following non-paired stimuli: effects of modality, intensity and rate of stimulation. , 1979, Electroencephalography and clinical neurophysiology.

[7]  M Hallett,et al.  Cortical activation during fast repetitive finger movements in humans: dipole sources of steady-state movement-related cortical potentials. , 1998, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[8]  E. Donchin,et al.  Detecting early communication: Using measures of movement-related potentials to illuminate human information processing , 1988, Biological Psychology.

[9]  J. Serences,et al.  Neural system for controlling the contents of object working memory in humans. , 2006, Cerebral cortex.

[10]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[11]  Peter Fransson,et al.  Sustained and Transient Neural Modulations in Prefrontal Cortex Related to Declarative Long-Term Memory, Working Memory, and Attention , 2007, Cortex.

[12]  Fan-Gang Zeng,et al.  Opposite patterns of hemisphere dominance for early auditory processing of lexical tones and consonants , 2006, Proceedings of the National Academy of Sciences.

[13]  Stephan Bender,et al.  Am I safe? The ventrolateral prefrontal cortex ‘detects’ when an unpleasant event does not occur , 2007, NeuroImage.

[14]  M. D’Esposito,et al.  Dissecting Contributions of Prefrontal Cortex and Fusiform Face Area to Face Working Memory , 2003, Journal of Cognitive Neuroscience.

[15]  Alan D. Baddeley,et al.  Verbal and visual subsystems of working memory , 1993, Current Biology.

[16]  J G Snodgrass,et al.  Remembering the color of objects: an ERP investigation of source memory. , 2001, Cerebral cortex.

[17]  R. Poldrack,et al.  Dissociable Controlled Retrieval and Generalized Selection Mechanisms in Ventrolateral Prefrontal Cortex , 2005, Neuron.

[18]  Stephan Bender,et al.  Motor processing after movement execution as revealed by evoked and induced activity. , 2004, Brain research. Cognitive brain research.

[19]  Antoine J. Shahin,et al.  Scalp Topography and Intracerebral Sources for ERPs Recorded During Auditory Target Detection , 2006, Brain Topography.

[20]  F. Rubia,et al.  Event-related potentials during memorization of spatial locations in the auditory and visual modalities. , 1997, Electroencephalography and clinical neurophysiology.

[21]  Michael Petrides,et al.  The mid‐ventrolateral prefrontal cortex: insights into its role in memory retrieval , 2003, The European journal of neuroscience.

[22]  H. Keselman,et al.  Detecting repeated measures effects with univariate and multivariate statistics , 1997 .

[23]  W. Sommer,et al.  Human brain potential correlates of face encoding into memory. , 1991, Electroencephalography and clinical neurophysiology.

[24]  L. Deecke,et al.  Neuromagnetic fields accompanying unilateral and bilateral voluntary movements: topography and analysis of cortical sources. , 1991, Electroencephalography and clinical neurophysiology.

[25]  Carlos M. Gómez,et al.  Fronto-parietal networks activation during the contingent negative variation period , 2007, Brain Research Bulletin.

[26]  W Lang,et al.  Cortical DC potential shifts accompanying auditory and visual short-term memory. , 1992, Electroencephalography and clinical neurophysiology.

[27]  J. Yordanova,et al.  Gender-specific development of auditory information processing in children: An ERP study , 2008, Clinical Neurophysiology.

[28]  Gregory A. Miller,et al.  A parietal–frontal network studied by somatosensory oddball MEG responses, and its cross-modal consistency , 2005, NeuroImage.

[29]  N. Kanwisher,et al.  Visual attention: Insights from brain imaging , 2000, Nature Reviews Neuroscience.

[30]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[31]  S. Curry,et al.  The form and distribution of auditory evoked potentials and CNVs when stimuli and responses are lateralized. , 1980, Progress in brain research.

[32]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[33]  M. D’Esposito,et al.  Functional connectivity during working memory maintenance , 2004, Cognitive, affective & behavioral neuroscience.

[34]  M. Steiner,et al.  Cerebral correlates of imagining colours, faces and a map—II. Negative cortical DC potentials , 1990, Neuropsychologia.

[35]  R. Shiffrin,et al.  Automatic and controlled processing revisited. , 1984, Psychological review.

[36]  Antonino Raffone,et al.  Selective attention in visual short-term memory consolidation , 2009, Neuroreport.

[37]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[38]  M. Petrides,et al.  Ventrolateral prefrontal neuronal activity related to active controlled memory retrieval in nonhuman primates. , 2007, Cerebral cortex.

[39]  R. Knight,et al.  Prefrontal modulation of visual processing in humans , 2000, Nature Neuroscience.

[40]  R Näätänen,et al.  Decay of cortical pre-attentive sound discrimination in middle-age. , 1999, Neuroreport.

[41]  J. Grafman,et al.  Distinctions and similarities among working memory processes: an event-related potential study. , 1992, Brain research. Cognitive brain research.

[42]  Edward K. Vogel,et al.  Pushing around the Locus of Selection: Evidence for the Flexible-selection Hypothesis , 2005, Journal of Cognitive Neuroscience.

[43]  A. Baddeley.  The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[44]  R. Berndt,et al.  Working memory retention systems: a state of activated long-term memory. , 2003, The Behavioral and brain sciences.

[45]  M. Hallett,et al.  Event-related desynchronization in reaction time paradigms: a comparison with event-related potentials and corticospinal excitability , 2001, Clinical Neurophysiology.

[46]  R. Knight,et al.  Auditory event-related potentials dissociate early and late memory processes. , 1995, Electroencephalography and clinical neurophysiology.

[47]  Carles Escera,et al.  When Loading Working Memory Reduces Distraction: Behavioral and Electrophysiological Evidence from an Auditory-Visual Distraction Paradigm , 2008, Journal of Cognitive Neuroscience.

[48]  Claude Alain,et al.  Assessing the auditory dual-pathway model in humans , 2004, NeuroImage.

[49]  J W Rohrbaugh,et al.  Slow brain potentials in a visual-spatial memory task: topographic distribution and inter-laboratory consistency. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[50]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[51]  E. Vogel,et al.  Interactions between attention and working memory , 2006, Neuroscience.

[52]  Joaquín M. Fuster,et al.  Executive frontal functions , 2000, Experimental Brain Research.

[53]  M. D’Esposito,et al.  Category-specific modulation of inferior temporal activity during working memory encoding and maintenance. , 2004, Brain research. Cognitive brain research.

[54]  Stephan Bender,et al.  How do children prepare to react? Imaging maturation of motor preparation and stimulus anticipation by late contingent negative variation , 2005, NeuroImage.

[55]  W Skrandies,et al.  Evoked potential correlates of semantic meaning--A brain mapping study. , 1998, Brain research. Cognitive brain research.

[56]  R S Berndt,et al.  Modality-specific processing streams in verbal working memory: evidence from spatio-temporal patterns of brain activity. , 1997, Brain research. Cognitive brain research.

[57]  N. Cowan.  Activation, attention, and short-term memory , 1993, Memory & cognition.

[58]  D B Lindsley,et al.  Synthesis of the contingent negative variation brain potential from noncontingent stimulus and motor elements. , 1980, Science.

[59]  Stephan Bender,et al.  Frontal lobe involvement in the processing of meaningful auditory stimuli develops during childhood and adolescence , 2006, NeuroImage.

[60]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[61]  R. Näätänen,et al.  Maturation of cortical sound processing as indexed by event-related potentials , 2002, Clinical Neurophysiology.

[62]  David Becker,et al.  Cortical motor areas are activated early in a characteristic sequence during post-movement processing , 2006, NeuroImage.

[63]  G. Sperling,et al.  Successive approximations to a model for short term memory. , 1967, Acta psychologica.

[64]  K. Berman,et al.  Human Dorsal and Ventral Auditory Streams Subserve Rehearsal-Based and Echoic Processes during Verbal Working Memory , 2005, Neuron.

[65]  R. Verleger,et al.  Slow EEG potentials (contingent negative variation and post-imperative negative variation) in schizophrenia: their association to the present state and to Parkinsonian medication effects , 1999, Clinical Neurophysiology.

[66]  Alan C. Evans,et al.  Genetic Contributions to Human Brain Morphology and Intelligence , 2006, The Journal of Neuroscience.

[67]  Maro G. Machizawa,et al.  Electrophysiological Measures of Maintaining Representations in Visual Working Memory , 2007, Cortex.

[68]  D. Schacter,et al.  Prefrontal Contributions to Executive Control: fMRI Evidence for Functional Distinctions within Lateral Prefrontal Cortex , 2001, NeuroImage.

[69]  B. Postle.  Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[70]  Friedemann Pulvermüller,et al.  Enhanced mismatch negativity brain response after binaural word presentation , 2004, The European journal of neuroscience.

[71]  F. Rösler,et al.  Monitoring retrieval from long-term memory by slow event-related brain potentials. , 1993, Psychophysiology.

[72]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.