A hemodynamic correlate of lateralized visual short-term memories

Neuroimaging studies attempting to isolate the neural substrate of visual short-term memory in humans have concentrated on the behavior of neurons populating the posterior part of the parietal cortex as a possible source of visual short-term memory capacity limits. Using a standard change-detection task, fMRI studies have shown that maintenance of bilaterally encoded objects elicited bilateral increases of hemodynamic activation in the intra-parietal and intra-occipital sulci (IPS-IOS) proportional to the number of objects retained in visual short-term memory. We used a spatially cued variant of the change-detection task to record hemodynamic responses to unilaterally encoded objects using functional near-infrared spectroscopy (fNIRS). Electrophysiological studies that employed this task have shown that maintenance of unilaterally encoded objects elicited posterior unilateral (contralateral) increase in event-related negativity proportional to the number of objects retained in visual short-term memory. We therefore examined whether contralateral increases in oxy-hemoglobin concentration correlated with the number of retained objects. Contrary to the idea that bilateral increases in BOLD responses and unilateral increases in event-related negativity may be different reflections of the same underlying neural/functional processing, memory-related increases in oxy-hemoglobin concentration were found bilaterally even when objects had to be encoded unilaterally. The present findings suggest that EEG and fMRI/fNIRS techniques reveal distinct neural signatures of the mechanisms supporting visual short-term memory.

[1]  E. Marg A VISION OF THE BRAIN , 1994 .

[2]  G K Aguirre,et al.  Neural components of topographical representation. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[3]  D. Ts'o,et al.  Cortical functional architecture and local coupling between neuronal activity and the microcirculation revealed by in vivo high-resolution optical imaging of intrinsic signals. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[4]  David A. Boas,et al.  Evidence that cerebral blood volume can provide brain activation maps with better spatial resolution than deoxygenated hemoglobin , 2005, NeuroImage.

[5]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[6]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[7]  J. Mayhew,et al.  Fine detail of neurovascular coupling revealed by spatiotemporal analysis of the hemodynamic response to single whisker stimulation in rat barrel cortex. , 2008, Journal of neurophysiology.

[8]  David A. Boas,et al.  A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans , 2006, NeuroImage.

[9]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[10]  A. Villringer,et al.  Near infrared spectroscopy (NIRS): A new tool to study hemodynamic changes during activation of brain function in human adults , 1993, Neuroscience Letters.

[11]  Hiroki Sato,et al.  Practicality of Wavelength Selection to Improve Signal-to-noise Ratio in Near-infrared Spectroscopy , 2003 .

[12]  Yevgeniy B. Sirotin,et al.  Reply to Uludağ: fMRI “initial dip” reflects increase in oxygenated hemoglobin , 2010, Proceedings of the National Academy of Sciences.

[13]  C. Frith,et al.  Neural correlates of change detection and change blindness , 2001, Nature Neuroscience.

[14]  Jeffrey S. Johnson,et al.  A Dynamic Neural Field Model of Visual Working Memory and Change Detection , 2009, Psychological science.

[15]  G. Logan Toward an instance theory of automatization. , 1988 .

[16]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[17]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[18]  Ronald A. Rensink The Dynamic Representation of Scenes , 2000 .

[19]  Nicolas Robitaille,et al.  Attentional control and capture in the attentional blink paradigm: Evidence from human electrophysiology , 2006 .

[20]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[21]  Frithjof Kruggel,et al.  Age dependency of the hemodynamic response as measured by functional near-infrared spectroscopy , 2003, NeuroImage.

[22]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[23]  Toshinori Kato,et al.  Paradoxical correlation between signal in functional magnetic resonance imaging and deoxygenated haemoglobin content in capillaries: a new theoretical explanation , 2002 .

[24]  G. Comi,et al.  IFCN standards for digital recording of clinical EEG. International Federation of Clinical Neurophysiology. , 1998, Electroencephalography and clinical neurophysiology.

[25]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[26]  R. Marois,et al.  "What" and "where" in the intraparietal sulcus: an FMRI study of object identity and location in visual short-term memory. , 2010, Cerebral cortex.

[27]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[28]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[29]  S. Ogawa,et al.  BOLD Based Functional MRI at 4 Tesla Includes a Capillary Bed Contribution: Echo‐Planar Imaging Correlates with Previous Optical Imaging Using Intrinsic Signals , 1995, Magnetic resonance in medicine.

[30]  Benoit Brisson,et al.  Dissociation of the N2pc and sustained posterior contralateral negativity in a choice response task , 2008, Brain Research.

[31]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[32]  Christine Lefebvre,et al.  Electrophysiological evidence of enhanced cortical activity in the human brain during visual curve tracing , 2010, Vision Research.

[33]  E. Vogel,et al.  Neural Measures of Individual Differences in Selecting and Tracking Multiple Moving Objects , 2008, The Journal of Neuroscience.

[34]  H. Pashler,et al.  Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1 , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[35]  E. Vogel,et al.  Contralateral delay activity provides a neural measure of the number of representations in visual working memory. , 2010, Journal of neurophysiology.

[36]  Nicolas Robitaille,et al.  Distinguishing between lateralized and nonlateralized brain activity associated with visual short-term memory: fMRI, MEG, and EEG evidence from the same observers , 2010, NeuroImage.

[37]  Archana K. Singh,et al.  Spatial registration of multichannel multi-subject fNIRS data to MNI space without MRI , 2005, NeuroImage.

[38]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[39]  E. Gratton,et al.  On-line optical imaging of the human brain with 160-ms temporal resolution. , 2000, Optics express.

[40]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[41]  Nicolas Robitaille,et al.  Oscillatory activity in parietal and dorsolateral prefrontal cortex during retention in visual short‐term memory: Additive effects of spatial attention and memory load , 2009, Human brain mapping.

[42]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[43]  Luciano Gamberini,et al.  Selective activation of the superior frontal gyrus in task-switching: An event-related fNIRS study , 2008, NeuroImage.

[44]  David E. Irwin,et al.  Visual masking and visual integration across saccadic eye movements. , 1988, Journal of experimental psychology. General.

[45]  Frédéric Gosselin,et al.  On the representation of words and nonwords in visual short-term memory: evidence from human electrophysiology. , 2009, Psychophysiology.

[46]  Ronald A. Rensink Visual Search for Change: A Probe into the Nature of Attentional Processing , 2000 .

[47]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[48]  P. Jolicoeur,et al.  Bilateral parietal and contralateral responses during maintenance of unilaterally encoded objects in visual short-term memory: evidence from magnetoencephalography. , 2009, Psychophysiology.

[49]  D. Yves von Cramon,et al.  Neurovascular coupling is impaired in cerebral microangiopathy—An event-related Stroop study , 2007, NeuroImage.

[50]  G. Woodman,et al.  The comparison of visual working memory representations with perceptual inputs. , 2009, Journal of experimental psychology. Human perception and performance.

[51]  Pierre Jolicoeur,et al.  Cumulative effects of concussions in athletes revealed by electrophysiological abnormalities on visual working memory , 2011, Journal of clinical and experimental neuropsychology.

[52]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[53]  Daniel J. Mitchell,et al.  Flexible, capacity-limited activity of posterior parietal cortex in perceptual as well as visual short-term memory tasks. , 2008, Cerebral cortex.

[54]  R Dell'Acqua,et al.  Spatial attention freezes during the attention blink. , 2006, Psychophysiology.

[55]  D. Delpy,et al.  Measurement of Cranial Optical Path Length as a Function of Age Using Phase Resolved Near Infrared Spectroscopy , 1994 .

[56]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[57]  Leslie G. Ungerleider,et al.  Neural Correlates of Visual Working Memory fMRI Amplitude Predicts Task Performance , 2002, Neuron.

[58]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[59]  Yevgeniy B. Sirotin,et al.  Spatiotemporal precision and hemodynamic mechanism of optical point spreads in alert primates , 2009, Proceedings of the National Academy of Sciences.

[60]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[61]  Nicolas Robitaille,et al.  On the control of visual spatial attention: evidence from human electrophysiology , 2006, Psychological research.

[62]  Marco Zorzi,et al.  A new method based on ICBM152 head surface for probe placement in multichannel fNIRS , 2011, NeuroImage.

[63]  John Jonides,et al.  Common and distinct neural correlates of perceptual and memorial selection , 2009, NeuroImage.

[64]  F Scarpa,et al.  Bayesian filtering of human brain hemodynamic activity elicited by visual short-term maintenance recorded through functional near-infrared spectroscopy (fNIRS). , 2010, Optics express.

[65]  Nicolas Robitaille,et al.  Attentional and anatomical considerations for the representation of simple stimuli in visual short-term memory: evidence from human electrophysiology , 2009, Psychological research.

[66]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[67]  A Maki,et al.  Visualizing human motor activity by using non-invasive optical topography. , 1996, Frontiers of medical and biological engineering : the international journal of the Japan Society of Medical Electronics and Biological Engineering.

[68]  Masako Okamoto,et al.  Three-dimensional probabilistic anatomical cranio-cerebral correlation via the international 10–20 system oriented for transcranial functional brain mapping , 2004, NeuroImage.

[69]  Yuhong Jiang,et al.  Visual working memory for simple and complex features: An fMRI study , 2006, NeuroImage.

[70]  Shylaja Devaraj,et al.  Signal processing for functional near-infrared neuroimaging , 2005 .

[71]  N. Cowan,et al.  A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. , 2007, Journal of experimental psychology. General.

[72]  Ying Xiong,et al.  The Triphasic Intrinsic Signal: Implications for Functional Imaging , 2007, The Journal of Neuroscience.

[73]  Roy Luria,et al.  Visual Short-term Memory Capacity for Simple and Complex Objects , 2010, Journal of Cognitive Neuroscience.

[74]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[75]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[76]  David J. Prime,et al.  Spatial layout of letters in nonwords affects visual short-term memory load: evidence from human electrophysiology. , 2011, Psychophysiology.

[77]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[78]  F. E. Grubbs Procedures for Detecting Outlying Observations in Samples , 1969 .

[79]  Pierre Jolicoeur,et al.  Mental Rotation Requires Visual Short-term Memory: Evidence from Human Electric Cortical Activity , 2010, Journal of Cognitive Neuroscience.

[80]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[81]  David A. Boas,et al.  A Quantitative Comparison of Simultaneous BOLD fMRI and NIRS Recordings during Functional Brain Activation , 2002, NeuroImage.

[82]  Maro G. Machizawa,et al.  Electrophysiological Measures of Maintaining Representations in Visual Working Memory , 2007, Cortex.

[83]  Abraham Z. Snyder,et al.  Changing Human Visual Field Organization from Early Visual to Extra-Occipital Cortex , 2007, PloS one.

[84]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.