Functional specialization for feature-based and symmetry-based groupings in multiple object tracking

Our vision systems utilize attention to process dynamic visual information everyday. Multiple object tracking (MOT) is widely used for studying sustained attention in dynamic environments. Previous research reported inter-target grouping based on feature similarity (e.g., targets sharing the same color, size, or shape) can facilitate tracking. A recent study also found that symmetric relation among targets in MOT tasks can automatically improve tracking performance, and a greater grouping effect based on symmetry and feature was observed. However, grouping based on multiple feature cues didn't produce a greater grouping effect than grouping based on one feature cue. Why were groupings based on symmetry and feature additive, but two feature-based groupings were not? How stimulus-driven inter-target groupings based on color or symmetry improve the goal-directed target tracking process remains unknown. We hypothesized that symmetry-based and feature-based groupings would involve different cortical and subcortical areas, and color-based and color-shape-based groupings would be manifested in significant activity in the same regions. This study used functional magnetic resonance imaging (fMRI) to identify cortical and subcortical areas involved in feature-based and symmetry-based groupings respectively during tracking. The results of our experiment showed that lateral occipital (LO) cortex is involved in symmetry-based grouping during tracking. Bilateral putamen, temporal parietal junction (TPJ), and frontal eye field (FEF) are involved in the feature-based grouping. Our findings likely indicate that stimulus-driven inter-target symmetry-based grouping and feature-based grouping improve goal-directed target tracking in different ways.

[1]  P. Cavanagh,et al.  Retinotopy and color sensitivity in human visual cortical area V8 , 1998, Nature Neuroscience.

[2]  J. Feldman.  The role of objects in perceptual grouping. , 1999, Acta psychologica.

[3]  Z. Pylyshyn.  Some primitive mechanisms of spatial attention , 1994, Cognition.

[4]  Lars T. Westlye,et al.  Attentional load modulates large-scale functional brain connectivity beyond the core attention networks , 2015, NeuroImage.

[5]  Sarah H. Creem,et al.  Defining the cortical visual systems: "what", "where", and "how". , 2001, Acta psychologica.

[6]  Brian A. Wandell,et al.  Predominantly extra-retinotopic cortical response to pattern symmetry , 2005, NeuroImage.

[7]  E. Rolls.  Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[8]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[9]  P. Cavanagh,et al.  Cortical fMRI activation produced by attentive tracking of moving targets. , 1998, Journal of neurophysiology.

[10]  S. Yantis.  Multielement visual tracking: Attention and perceptual organization , 1992, Cognitive Psychology.

[11]  Jonathan E. Jennings,et al.  An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex. , 1999, Cerebral cortex.

[12]  J. Hyönä,et al.  Is multiple object tracking carried out automatically by an early vision mechanism independent of higher‐order cognition? An individual difference approach , 2004 .

[13]  D. Tomasi,et al.  Practice-induced changes of brain function during visual attention: a parametric fMRI study at 4 Tesla , 2004, NeuroImage.

[14]  D. V. van Essen,et al.  The Processing of Visual Shape in the Cerebral Cortex of Human and Nonhuman Primates: A Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[15]  A. Dale,et al.  The Representation of Illusory and Real Contours in Human Cortical Visual Areas Revealed by Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[16]  J. Wolfe,et al.  Using Fmri to Distinguish Components of the Multiple Object Tracking Task , 1994 .

[17]  Wim Vanduffel,et al.  Symmetry activates extrastriate visual cortex in human and nonhuman primates. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Todd S Horowitz,et al.  The what–where trade-off in multiple-identity tracking , 2011, Attention, perception & psychophysics.

[19]  Z. Pylyshyn.  Visual indexes, preconceptual objects, and situated vision , 2001, Cognition.

[20]  B. Scholl.  Objects and attention: the state of the art , 2001, Cognition.

[21]  N. Volkow,et al.  Functional connectivity and brain activation: a synergistic approach. , 2014, Cerebral cortex.

[22]  Kazuhiko Yokosawa,et al.  Grouping and Trajectory Storage in Multiple Object Tracking: Impairments Due to Common Item Motions , 2006, Perception.

[23]  Alex O. Holcombe,et al.  Tracking the changing features of multiple objects: Progressively poorer perceptual precision and progressively greater perceptual lag , 2008, Vision Research.

[24]  Yi Lei,et al.  Functional imaging of brain responses to different outcomes of hypothesis testing: revealed in a category induction task , 2013, NeuroImage.

[25]  A. Franklin,et al.  Categorical encoding of color in the brain , 2014, Proceedings of the National Academy of Sciences.

[26]  Juha Silvanto,et al.  The causal role of the lateral occipital complex in visual mirror symmetry detection and grouping: An fMRI-guided TMS study , 2014, Cortex.

[27]  Tal Makovski,et al.  The role of visual working memory in attentive tracking of unique objects. , 2009, Journal of experimental psychology. Human perception and performance.

[28]  Multiple regulation of the galactose operon-genetic evidence for a distinct site in the galactose operon that responds to capR gene regulation in Escherichia coli K-12. , 1974, Proceedings of the National Academy of Sciences of the United States of America.

[29]  P. Cavanagh,et al.  Attention Response Functions Characterizing Brain Areas Using fMRI Activation during Parametric Variations of Attentional Load , 2001, Neuron.

[30]  Cary S Feria,et al.  The Effects of Distractors in Multiple Object Tracking are Modulated by the Similarity of Distractor and Target Features , 2012, Perception.

[31]  Lauri Oksama,et al.  Cortical Circuit for Binding Object Identity and Location During Multiple-Object Tracking , 2016, Cerebral cortex.

[32]  T. Paus.  Location and function of the human frontal eye-field: A selective review , 1996, Neuropsychologia.

[33]  Markus H. Sneve,et al.  Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus. , 2014, Journal of vision.

[34]  P. Howe,et al.  The Effect of Visual Distinctiveness on Multiple Object Tracking Performance , 2012, Front. Psychology.

[35]  Todd S Horowitz,et al.  Automatic feature-based grouping during multiple object tracking. , 2011, Journal of experimental psychology. Human perception and performance.

[36]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[37]  B. Scholl.  What Have We Learned about Attention from Multiple-Object Tracking (and Vice Versa)? , 2009 .

[38]  G. Alvarez,et al.  Space and time, not surface features, guide object persistence , 2007, Psychonomic bulletin & review.

[39]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[40]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[41]  Z. Pylyshyn,et al.  Multiple parallel access in visual attention. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[42]  Yuhong Jiang,et al.  Feature binding in attentive tracking of distinct objects , 2009, Visual cognition.

[43]  Christopher L. Asplund,et al.  A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention , 2010, Nature Neuroscience.

[44]  H. Karnath,et al.  Keeping Memory Clear and Stable—The Contribution of Human Basal Ganglia and Prefrontal Cortex to Working Memory , 2010, The Journal of Neuroscience.

[45]  Ben M. Crittenden,et al.  Task Difficulty Manipulation Reveals Multiple Demand Activity but no Frontal Lobe Hierarchy , 2012, Cerebral cortex.

[46]  Tobias Teichert,et al.  Performance Monitoring in Monkey Frontal Eye Field , 2014, The Journal of Neuroscience.

[47]  Z. Pylyshyn.  The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[48]  Jonathan Flombaum,et al.  Spatiotemporal priority as a fundamental principle of object persistence , 2009 .

[49]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[50]  Chuang Lyu,et al.  The Categorical Distinction Between Targets and Distractors Facilitates Tracking in Multiple Identity Tracking Task , 2016, Front. Psychol..

[51]  Nadia M. Brashier,et al.  Memory Meets Control in Hippocampal and Striatal Binding of Stimuli, Responses, and Attentional Control States , 2015, The Journal of Neuroscience.

[52]  Xuemin Zhang,et al.  Additivity of Feature-Based and Symmetry-Based Grouping Effects in Multiple Object Tracking , 2016, Front. Psychol..

[53]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[54]  Jukka Hyönä,et al.  Dynamic binding of identity and location information: A serial model of multiple identity tracking , 2008, Cognitive Psychology.

[55]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[56]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[57]  C. Koch,et al.  Brain Areas Specific for Attentional Load in a Motion-Tracking Task , 2001, Journal of Cognitive Neuroscience.

[58]  Z W Pylyshyn,et al.  Searching through subsets: a test of the visual indexing hypothesis. , 1997, Spatial vision.

[59]  Patrice D. Tremoulet,et al.  Individuation of visual objects over time , 2006, Cognition.

[60]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[61]  T. Paus,et al.  Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: a review of 107 PET activation studies , 1998, Neuroreport.

[62]  Leslie G. Ungerleider,et al.  Complementary Roles of Systems Representing Sensory Evidence and Systems Detecting Task Difficulty During Perceptual Decision Making , 2010, Front. Neurosci..

[63]  B. Scholl.  Object Persistence in Philosophy and Psychology , 2007 .

[64]  Tutis Vilis,et al.  The lateral occipital complex subserves the perceptual persistence of motion-defined groupings. , 2003, Cerebral cortex.

[65]  D. Tomasi,et al.  Different activation patterns for working memory load and visual attention load , 2007, Brain Research.

[66]  Hong Li,et al.  How the brain detects invariance and inhibits variance during category induction , 2016, Neuroscience Letters.

[67]  Edmund T. Rolls,et al.  Implementation of a new parcellation of the orbitofrontal cortex in the automated anatomical labeling atlas , 2015, NeuroImage.

[68]  Shawn W. Ell,et al.  Focal putamen lesions impair learning in rule-based, but not information-integration categorization tasks , 2006, Neuropsychologia.

[69]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[70]  Z. Pylyshyn.  Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities , 2004 .

[71]  J. Wolfe,et al.  Tracking unique objects , 2007, Perception & psychophysics.

[72]  P. Kellman,et al.  Attentional Signatures of Perception: Multiple Object Tracking Reveals the Automaticity of Contour Interpolation Interpolation as an Attention-driving Process? or vice Versa? , 2022 .