Distributed and Overlapping Neural Substrates for Object Individuation and Identification in Visual Short-Term Memory.

Object individuation and identification are 2 key processes involved in representing visual information in short-term memory (VSTM). Individuation involves the use of spatial and temporal cues to register an object as a distinct perceptual event relative to other stimuli, whereas object identification involves extraction of featural and related conceptual properties of a stimulus. Together, individuation and identification provide the "what," "where," and "when" of visual perception. In the current study, we asked whether individuation and identification processes are underpinned by distinct neural substrates, and to what extent brain regions that reflect these 2 operations are consistent across encoding, maintenance, and retrieval stages of VSTM. We used functional magnetic resonance imaging to identify brain regions that represent the number of objects (individuation) and/or object features (identification) in an array. Using univariate and multivariate analyses, we found substantial overlap between these 2 operations in the brain. Moreover, we show that regions supporting individuation and identification vary across distinct stages of information processing. Our findings challenge influential models of multiple-object encoding in VSTM, which argue that individuation and identification are underpinned by a limited set of nonoverlapping brain regions.

[1]  I. Peretz,et al.  Evidence for the role of the right auditory cortex in fine pitch resolution , 2008, Neuropsychologia.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  J. Duncan The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[4]  Yaoda Xu,et al.  Neural Representation of Targets and Distractors during Object Individuation and Identification , 2010, Journal of Cognitive Neuroscience.

[5]  N Kanwisher,et al.  Determinants of repetition blindness. , 1994, Journal of experimental psychology. Human perception and performance.

[6]  D. V. von Cramon,et al.  Localization of Executive Functions in Dual-Task Performance with fMRI , 2002, Journal of Cognitive Neuroscience.

[7]  M. Chun,et al.  Types and tokens in visual processing: a double dissociation between the attentional blink and repetition blindness. , 1997, Journal of experimental psychology. Human perception and performance.

[8]  Daeyeol Lee,et al.  Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain , 2011, Neuron.

[9]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[10]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[11]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[12]  Kenneth F. Valyear,et al.  Decoding Action Intentions from Preparatory Brain Activity in Human Parieto-Frontal Networks , 2011, The Journal of Neuroscience.

[13]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[14]  N. Kanwisher Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[15]  Jonathan D. Cohen,et al.  Confounds in multivariate pattern analysis: Theory and rule representation case study , 2013, NeuroImage.

[16]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[17]  J. Duncan The Structure of Cognition: Attentional Episodes in Mind and Brain , 2013, Neuron.

[18]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[19]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[20]  Benjamin J. Tamber-Rosenau,et al.  Cortical Mechanisms of Cognitive Control for Shifting Attention in Vision and Working Memory , 2011, Journal of Cognitive Neuroscience.

[21]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[22]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[23]  Yaoda Xu,et al.  Representing connected and disconnected shapes in human inferior intraparietal sulcus , 2008, NeuroImage.

[24]  P. Morosan,et al.  Probabilistic Mapping and Volume Measurement of Human Primary Auditory Cortex , 2001, NeuroImage.

[25]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[26]  Yaoda Xu,et al.  The Neural Fate of Task-Irrelevant Features in Object-Based Processing , 2010, The Journal of Neuroscience.

[27]  Christopher L. Asplund,et al.  A Unified attentional bottleneck in the human brain , 2011, Proceedings of the National Academy of Sciences.

[28]  Benjamin J. Tamber-Rosenau,et al.  Decoding cognitive control in human parietal cortex , 2009, Proceedings of the National Academy of Sciences.

[29]  Benjamin J. Tamber-Rosenau,et al.  The neural basis of temporal individuation and its capacity limits in the human brain. , 2017, Journal of neurophysiology.

[30]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[31]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[32]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[33]  Christopher L. Asplund,et al.  Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI , 2006, Neuron.

[34]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[35]  Yaoda Xu The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects , 2007, The Journal of Neuroscience.

[36]  F. Tong,et al.  Training Improves Multitasking Performance by Increasing the Speed of Information Processing in Human Prefrontal Cortex , 2009, Neuron.

[37]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[38]  Z. Pylyshyn The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[39]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[40]  J. Jonides,et al.  Neuroimaging analyses of human working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[41]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[42]  Yaoda Xu,et al.  Visual grouping in human parietal cortex , 2007, Proceedings of the National Academy of Sciences.

[43]  Paul E. Downing,et al.  Viewpoint (In)dependence of Action Representations: An MVPA Study , 2012, Journal of Cognitive Neuroscience.

[44]  Thad A. Polk,et al.  Age differences in neural distinctiveness revealed by multi-voxel pattern analysis , 2011, NeuroImage.

[45]  Adam C. Riggall,et al.  Distributed Patterns of Activity in Sensory Cortex Reflect the Precision of Multiple Items Maintained in Visual Short-Term Memory , 2013, The Journal of Neuroscience.

[46]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .