The right temporo-parietal junction contributes to visual feature binding

We investigated the neural basis of conjoined processing of color and spatial frequency with functional magnetic resonance imaging (fMRI). A multivariate classification algorithm was trained to differentiate between either isolated color or spatial frequency differences, or between conjoint differences in both feature dimensions. All displays were presented in a singleton search task, avoiding confounds between conjunctive feature processing and search difficulty that arose in previous studies contrasting single feature and conjunction search tasks. Based on patient studies, we expected the right temporo-parietal junction (TPJ) to be involved in conjunctive feature processing. This hypothesis was confirmed in that only conjoined color and spatial frequency differences, but not isolated feature differences could be classified above chance level in this area. Furthermore, we could show that the accuracy of a classification of differences in both feature dimensions was superadditive compared to the classification accuracies of isolated color or spatial frequency differences within the right TPJ. These data provide evidence for the processing of feature conjunctions, here color and spatial frequency, in the right TPJ.

[1]  Louis K. H. Chan,et al.  Feature integration theory revisited: dissociating feature detection and attentional guidance in visual search. , 2009, Journal of experimental psychology. Human perception and performance.

[2]  R. Goebel,et al.  Integration of Letters and Speech Sounds in the Human Brain , 2004, Neuron.

[3]  A. Treisman,et al.  Parietal contributions to visual feature binding: evidence from a patient with bilateral lesions , 1995, Science.

[4]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[5]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[6]  Uta Noppeney,et al.  Characterization of Multisensory Integration with fMRI , 2012 .

[7]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[8]  R. Goebel,et al.  Multisensory functional magnetic resonance imaging: a future perspective , 2009, Experimental Brain Research.

[9]  Muge M. Bakircioglu,et al.  Mapping visual cortex in monkeys and humans using surface-based atlases , 2001, Vision Research.

[10]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[11]  Stefan Pollmann,et al.  PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data , 2009, Neuroinformatics.

[12]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[13]  G. Calvert.  Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[14]  J. Wolfe,et al.  Fractionating the binding process: neuropsychological evidence distinguishing binding of form from binding of surface features , 2000, Vision Research.

[15]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[16]  Joy J. Geng,et al.  Neuroscience and Biobehavioral Reviews Review Re-evaluating the Role of Tpj in Attentional Control: Contextual Updating? , 2022 .

[17]  M. Corbetta,et al.  Right TPJ deactivation during visual search: functional significance and support for a filter hypothesis. , 2007, Cerebral cortex.

[18]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[19]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[20]  S. Yantis,et al.  An interactive race model of divided attention. , 1991, Journal of experimental psychology. Human perception and performance.

[21]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[23]  Alan Cowey,et al.  Temporal aspects of visual search studied by transcranial magnetic stimulation , 1997, Neuropsychologia.

[24]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[25]  Lawrence Carin,et al.  Sparse multinomial logistic regression: fast algorithms and generalization bounds , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  A Treisman,et al.  Feature binding, attention and object perception. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  John C Gore,et al.  The role of the parietal cortex in visual feature binding , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[29]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[30]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[31]  Rolf Ulrich,et al.  Testing the race model inequality: An algorithm and computer programs , 2007, Behavior research methods.

[32]  Lynn C. Robertson,et al.  Attenuating illusory binding with TMS of the right parietal cortex , 2007, NeuroImage.

[33]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[34]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[35]  Notger G. Müller,et al.  The functional neuroanatomy of visual conjunction search: a parametric fMRI study , 2003, NeuroImage.

[36]  S. Huettel,et al.  A nexus model of the temporal–parietal junction , 2013, Trends in Cognitive Sciences.

[37]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[38]  R. Campbell,et al.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex , 2000, Current Biology.

[39]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[40]  Michael S. Beauchamp,et al.  Statistical criteria in fMRI studies of multisensory integration , 2005, Neuroinformatics.

[41]  C. Kennard,et al.  The anatomy of visual neglect , 2003 .

[42]  Simon B. Eickhoff,et al.  Assignment of functional activations to probabilistic cytoarchitectonic areas revisited , 2007, NeuroImage.

[43]  Jochen Kaiser,et al.  Multisensory Functional Magnetic Resonance Imaging , 2010 .

[44]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[45]  U. Noppeney,et al.  Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. , 2010, Cerebral cortex.

[46]  Alan Cowey,et al.  Cortical plasticity in perceptual learning demonstrated by transcranial magnetic stimulation , 1998, Neuropsychologia.

[47]  J. Rieger,et al.  Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices , 2007, The Journal of Neuroscience.

[48]  Yaroslav O. Halchenko,et al.  Open is Not Enough. Let's Take the Next Step: An Integrated, Community-Driven Computing Platform for Neuroscience , 2012, Front. Neuroinform..

[49]  Arno Villringer,et al.  Visual Feature and Conjunction Searches of Equal Difficulty Engage Only Partially Overlapping Frontoparietal Networks , 2002, NeuroImage.

[50]  Hermann J. Müller,et al.  Neural correlates of binding features within- or cross-dimensions in visual conjunction search: An fMRI study , 2011, NeuroImage.

[51]  J. Driver,et al.  Sound-Induced Enhancement of Low-Intensity Vision: Multisensory Influences on Human Sensory-Specific Cortices and Thalamic Bodies Relate to Perceptual Enhancement of Visual Detection Sensitivity , 2010, The Journal of Neuroscience.

[52]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[53]  Glyn W. Humphreys,et al.  Fractionating the binding process. , 2000 .

[54]  Stefan Pollmann,et al.  Evidence for feature binding in the superior parietal lobule , 2013, NeuroImage.

[55]  Umberto Castiello,et al.  The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies , 2003, NeuroImage.

[56]  Jonas T. Kaplan,et al.  Multivariate pattern analysis reveals common neural patterns across individuals during touch observation , 2012, NeuroImage.