The Contribution of Human Superior Intraparietal Sulcus to Visual Short-Term Memory and Perception

The human superior intraparietal sulcus (IPS) has been shown to track the number of items stored in visual short-term memory. Although prior studies have implied that this brain region can represent a variety of visual information dynamically based on task demands, existing neuropsychological and neuroimaging studies have associated human parietal cortex primarily with attention-related processing. As such, superior IPS activation may simply track the deployment of attentional resources without actually carrying any detailed visual representations. Using functional magnetic resonance imaging and multivoxel pattern analysis, we found that, with identical visual input under different task conditions, neural response patterns in the superior IPS contained object shape information only when it was required by the task. This finding puts forward an alternative, perhaps equally important, mechanism by which parietal attention control mechanism can exert its influence on visual information processing in the brain. By directly encoding task-relevant visual information, superior IPS functions similarly to the random access memory in a computer in which information important for the current task and goal is gathered and possibly integrated. This finding adds to the growing body of evidence suggesting that the human parietal cortex is part of a brain network involved in the flexible and dynamic representation and processing of incoming information. We argue that superior IPS may be a key node in this network and mediates the moment-to-moment goal-directed visual information representation in the human brain.

[1]  Justin L. Vincent,et al.  Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[2]  S. Yantis,et al.  Transient neural activity in human parietal cortex during spatial attention shifts , 2002, Nature Neuroscience.

[3]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[4]  Paul E. Downing,et al.  Using multi-voxel pattern analysis of fMRI data to interpret overlapping functional activations , 2007, Trends in Cognitive Sciences.

[5]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[6]  Yaoda Xu,et al.  Encoding color and shape from different parts of an object in visual short-term memory , 2002, Perception & psychophysics.

[7]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[8]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[9]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[10]  Ken Nakayama,et al.  The consequences of subtracting the mean pattern in fMRI multivariate correlation analyses , 2013, Front. Neurosci..

[11]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[12]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[13]  David J. Freedman,et al.  Visual categorization and the parietal cortex , 2012, Front. Integr. Neurosci..

[14]  T. R. Jordan,et al.  Perception and action in 'visual form agnosia'. , 1991, Brain : a journal of neurology.

[15]  N. Kanwisher,et al.  Only some spatial patterns of fMRI response are read out in task performance , 2007, Nature Neuroscience.

[16]  L. Shah,et al.  Functional magnetic resonance imaging. , 2010, Seminars in roentgenology.

[17]  Dwight J. Kravitz,et al.  High-level visual object representations are constrained by position. , 2010, Cerebral cortex.

[18]  Adam C. Riggall,et al.  Distributed Patterns of Activity in Sensory Cortex Reflect the Precision of Multiple Items Maintained in Visual Short-Term Memory , 2013, The Journal of Neuroscience.

[19]  Justin L. Gardner,et al.  Feature-Specific Attentional Priority Signals in Human Cortex , 2011, The Journal of Neuroscience.

[20]  P. Downing,et al.  Mapping brain activation and information during category-specific visual working memory. , 2012, Journal of neurophysiology.

[21]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[22]  Yaoda Xu,et al.  Visual grouping in human parietal cortex , 2007, Proceedings of the National Academy of Sciences.

[23]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[24]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[25]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[26]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[27]  David J. Freedman,et al.  Preferential Encoding of Visual Categories in Parietal Cortex Compared to Prefrontal Cortex , 2011, Nature Neuroscience.

[28]  David J. Freedman,et al.  Distinct Encoding of Spatial and Nonspatial Visual Information in Parietal Cortex , 2009, The Journal of Neuroscience.

[29]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[30]  Yaoda Xu,et al.  Representing connected and disconnected shapes in human inferior intraparietal sulcus , 2008, NeuroImage.

[31]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[32]  Yaoda Xu,et al.  The Neural Fate of Task-Irrelevant Features in Object-Based Processing , 2010, The Journal of Neuroscience.

[33]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[34]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[35]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[36]  Nancy Kanwisher,et al.  Broad domain generality in focal regions of frontal and parietal cortex , 2013, Proceedings of the National Academy of Sciences.

[37]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[38]  Hana Burianova,et al.  Transient Perceptual Neglect: Visual Working Memory Load Affects Conscious Object Processing , 2011, Journal of Cognitive Neuroscience.

[39]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[40]  John Duncan,et al.  Attentional modulation of stimulus representation in human fronto-parietal cortex , 2009, NeuroImage.

[41]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[42]  John-Dylan Haynes,et al.  Decoding complex flow-field patterns in visual working memory , 2014, NeuroImage.

[43]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[44]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[45]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[46]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[47]  Jonathan D. Power,et al.  Multi-task connectivity reveals flexible hubs for adaptive task control , 2013, Nature Neuroscience.

[48]  Bahador Bahrami,et al.  Object property encoding and change blindness in multiple object tracking , 2003 .

[49]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[50]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[51]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[52]  N. Kanwisher,et al.  The Generality of Parietal Involvement in Visual Attention , 1999, Neuron.

[53]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[54]  Morgan D Barense,et al.  To bind or not to bind: addressing the question of object representation in visual short-term memory. , 2012, Journal of vision.

[55]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[56]  Yaoda Xu The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects , 2007, The Journal of Neuroscience.

[57]  Patrice D. Tremoulet,et al.  Indexing and the object concept: developing `what' and `where' systems , 1998, Trends in Cognitive Sciences.

[58]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[59]  S. Kastner,et al.  Mechanisms of Spatial Attention Control in Frontal and Parietal Cortex , 2010, The Journal of Neuroscience.

[60]  R. Marois,et al.  Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity , 2005, Cognitive, affective & behavioral neuroscience.

[61]  Nancy Kanwisher,et al.  The distribution of category and location information across object-selective regions in human visual cortex , 2008, Proceedings of the National Academy of Sciences.

[62]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[63]  H. Coslett,et al.  Simultanagnosia. To see but not two see. , 1991, Brain : a journal of neurology.