Misbinding of Color and Motion in Human Visual Cortex

A fundamental challenge for the visual system is to integrate visual features into a coherent scene, known as the binding problem. The neural mechanisms of feature binding are hard to identify because of difficulties in separating active feature binding from feature co-occurrence. In previous studies on feature binding, visual features were superimposed and presented simultaneously. Neurons throughout the visual cortex are known to code multiple features. Therefore, the observed binding effects could be due to the physical co-occurrence of features and the sensory representation of feature pairings. It is uncertain whether the mechanisms responsible for perceptual binding were actually recruited. To address this issue, we performed psychophysical and fMRI experiments to investigate the neural mechanisms of a steady-state misbinding of color and motion, because feature misbinding is probably the most striking evidence for the active existence of the binding mechanisms. We found that adapting to the color-motion misbinding generated the color-contingent motion aftereffect, as well as the color-contingent motion adaptation effect in visual cortex. Notably, V2 exhibited the strongest adaptation effect, which significantly correlated with the aftereffect across subjects. Furthermore, effective connectivity analysis using dynamic causal modeling showed that the misbinding was closely associated with enhanced feedback from V4 and V5 to V2. These findings provide strong evidence for active feature binding in early visual cortex and suggest a critical role of reentrant connections from specialized intermediate areas to early visual cortex in this process.

[1]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[2]  H. Tamura,et al.  Less Segregated Processing of Visual Information in V2 than in V1 of the Monkey Visual Cortex , 1996, The European journal of neuroscience.

[3]  Juha Silvanto,et al.  Relationship between visual binding, reentry and awareness , 2011, Consciousness and Cognition.

[4]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[5]  R. Ivry,et al.  Loosening the constraints on illusory conjunctions: assessing the roles of exposure duration and attention. , 1995, Journal of experimental psychology. Human perception and performance.

[6]  Stuart Anstis,et al.  Movement aftereffects contingent on color, intensity, and pattern , 1972 .

[7]  Bevil R. Conway,et al.  Toward a Unified Theory of Visual Area V4 , 2012, Neuron.

[8]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[9]  Erik Blaser,et al.  Binding of motion and colour is early and automatic , 2005, The European journal of neuroscience.

[10]  Seth E. Bouvier,et al.  Visual Feature Binding Requires Reentry , 2010, Psychological science.

[11]  K R Gegenfurtner,et al.  Processing of color, form, and motion in macaque area V2 , 1996, Visual Neuroscience.

[12]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[13]  J. Wolfe,et al.  The Psychophysical Evidence for a Binding Problem in Human Vision , 1999, Neuron.

[14]  Klaas E. Stephan,et al.  Dynamic Causal Models for fMRI , 2015 .

[15]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[16]  C F Stromeyer,et al.  Contour-contingent color aftereffects: retinal area specificity. , 1972, The American journal of psychology.

[17]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[18]  Karl J. Friston CHAPTER 41 – Dynamic Causal Models for fMRI , 2007 .

[19]  V. Lollo The feature-binding problem is an ill-posed problem , 2012, Trends in Cognitive Sciences.

[20]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[21]  Patrick Cavanagh,et al.  Early binding of feature pairs for visual perception , 2001, Nature Neuroscience.

[22]  Bruno A Olshausen,et al.  Processing shape, motion and three-dimensional shape-from-motion in the human cortex. , 2003, Cerebral cortex.

[23]  Seth E. Bouvier,et al.  Activity in visual area V4 correlates with surface perception. , 2008, Journal of vision.

[24]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[25]  Shinsuke Shimojo,et al.  Vision: Steady-state misbinding of colour and motion , 2004, Nature.

[26]  D. Whitney Neuroscience: Toward Unbinding the Binding Problem , 2009, Current Biology.

[27]  Semir Zeki,et al.  Feature binding in the feedback layers of area V2. , 2009, Cerebral cortex.

[28]  D. Kersten,et al.  Opposite Modulation of High- and Low-Level Visual Aftereffects by Perceptual Grouping , 2012, Current Biology.

[29]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[30]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[31]  Lawrence C. Sincich,et al.  Input to V2 Thin Stripes Arises from V1 Cytochrome Oxidase Patches , 2005, The Journal of Neuroscience.

[32]  Andreas Bartels,et al.  The Coding of Color, Motion, and Their Conjunction in the Human Visual Cortex , 2009, Current Biology.

[33]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[34]  Andreas Bartels,et al.  Coding and binding of color and form in visual cortex. , 2010, Cerebral cortex.