Solutions for the Binding Problem

Abstract Visual cortical neurons are broadly tuned to one or a few feature dimensions, like color and motion. This is advantageous because broadly tuned neurons can contribute to the representation of many visual scenes. However, if there are multiple objects in a visual scene, the cortex is at risk to combine features of different objects as if they belong to a single object. The term “binding problem” was introduced to refer to the difficulties that may occur in sorting out those responses that are evoked by a single perceptual object. The present article reviews proposals suggesting that the binding problem is solved by labelling an assembly of neurons that is responsive to a single perceptual obejct. Evidence is reviewed in favor of two possible assembly-labels: rate enhancement due to visual attention and neuronal synchrony. Assembly-labels should be spread through the cortical network to all neurons that have to participate in an assembly The present article tries to shed light on the mechanisms that subserve such a selective spread of assembly labels. Moreover, it is suggested that assembly labels may fulfill an equivalent role in the motor system, since binding problems can also occur during the generation of useful patterns of motor activity.

[1]  M. Wertheimer Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[2]  J. Beck Effect of orientation and of shape similarity on perceptual grouping , 1966 .

[3]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[4]  P. Milner A model for visual shape recognition. , 1974, Psychological review.

[5]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[6]  D. Robinson,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. , 1981, Journal of neurophysiology.

[7]  W Prinzmetal,et al.  Principles of feature integration in visual perception , 1981, Perception & psychophysics.

[8]  Professor Moshe Abeles,et al.  Local Cortical Circuits , 1982, Studies of Brain Function.

[9]  R. Freeman,et al.  An electrophysiological comparison of convergent and divergent strabismus in the cat: electrical and visual activation of single cortical cells. , 1983, Journal of neurophysiology.

[10]  Y. Chino,et al.  Effects of rearing kittens with convergent strabismus on development of receptive-field properties in striate cortex neurons. , 1983, Journal of neurophysiology.

[11]  B. Julesz A brief outline of the texton theory of human vision , 1984, Trends in Neurosciences.

[12]  F. Crick Function of the thalamic reticular complex: the searchlight hypothesis. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[13]  W. Freeman,et al.  Spatial EEG patterns, non-linear dynamics and perception: the neo-sherringtonian view , 1985, Brain Research Reviews.

[14]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[15]  J. Tanji,et al.  Premotor cortex neurons in macaques: activity before distal and proximal forelimb movements , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  J. T. Murphy,et al.  Interaction between neurons in precentral cortical zones controlling different joints , 1987, Brain Research.

[17]  R. Desimone,et al.  Behavioral neurophysiology: insights into seeing and grasping. , 1988, Science.

[18]  G. Rizzolatti Motor and visual-motor functions of the premotor cortex , 1988 .

[19]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[20]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[21]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  G. Edelman,et al.  Reentrant signaling among simulated neuronal groups leads to coherency in their oscillatory activity. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[23]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[24]  K. Kaneko Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements , 1990 .

[25]  H Sompolinsky,et al.  Global processing of visual stimuli in a neural network of coupled oscillators. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[26]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[27]  W. Singer,et al.  Stimulus‐Dependent Neuronal Oscillations in Cat Visual Cortex: Inter‐Columnar Interaction as Determined by Cross‐Correlation Analysis , 1990, The European journal of neuroscience.

[28]  P König,et al.  Direct physiological evidence for scene segmentation by temporal coding. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[29]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Peter König,et al.  Stimulus-Dependent Assembly Formation of Oscillatory Responses: I. Synchronization , 1991, Neural Computation.

[31]  A. Kramer,et al.  Perceptual organization and focused attention: The role of objects and proximity in visual processing , 1991, Perception & psychophysics.

[32]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[33]  Rodney J. Douglas,et al.  Synchronization of Bursting Action Potential Discharge in a Model Network of Neocortical Neurons , 1991, Neural Computation.

[34]  C Blakemore Different neural origins for 'blur' amblyopia and strabismic amblyopia , 1992 .

[35]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[36]  W. Singer,et al.  Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. , 1992, Science.

[37]  J. Kalaska,et al.  Cerebral cortical mechanisms of reaching movements. , 1992, Science.

[38]  Paul Antoine Salin,et al.  Spatial and temporal coherence in cortico-cortical connections: a cross-correlation study in areas 17 and 18 in the cat. , 1992, Visual neuroscience.

[39]  G. Baylis,et al.  Visual parsing and response competition: The effect of grouping factors , 1992, Perception & psychophysics.

[40]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[41]  C. Gilbert Horizontal integration and cortical dynamics , 1992, Neuron.

[42]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[43]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[44]  P. König,et al.  Why does the cortex oscillate? , 1992, Current Biology.

[45]  Martha J. Farah,et al.  'What' and 'Where' in Visual Attention: Evidence from the Neglect Syndrome , 1992 .

[46]  E. Fetz,et al.  Coherent 25- to 35-Hz oscillations in the sensorimotor cortex of awake behaving monkeys. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Glyn W. Humphreys,et al.  Interactions between object and space systems revealed through neuropsychology , 1993 .

[48]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[49]  W. Singer Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[50]  J. Donoghue,et al.  Oscillations in local field potentials of the primate motor cortex during voluntary movement. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. Sireteanu,et al.  Distortions in two-dimensional visual space perception in strabismic observers , 1993, Vision Research.

[52]  Jeffrey D. Schall,et al.  Neural basis of saccade target selection in frontal eye field during visual search , 1993, Nature.

[53]  W. Singer,et al.  Squint Affects Synchronization of Oscillatory Responses in Cat Visual Cortex , 1993, The European journal of neuroscience.

[54]  B. C. Motter Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. , 1993, Journal of neurophysiology.

[55]  H. Komatsu,et al.  Relationships between color, shape, and pattern selectivities of neurons in the inferior temporal cortex of the monkey. , 1993, Journal of neurophysiology.

[56]  S. Bressler,et al.  Episodic multiregional cortical coherence at multiple frequencies during visual task performance , 1993, Nature.

[57]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  R. Eckhorn,et al.  Stimulus-specific fast oscillations at zero phase between visual areas V1 and V2 of awake monkey. , 1994, Neuroreport.

[59]  R. Malach,et al.  Relationship between orientation domains, cytochrome oxidase stripes, and intrinsic horizontal connections in squirrel monkey area V2. , 1994, Cerebral cortex.

[60]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[61]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[62]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[63]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[64]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[65]  Glyn W. Humphreys,et al.  Non-spatial extinction following lesions of the parietal lobe in humans , 1994, Nature.

[66]  W. Singer,et al.  Reduced Synchronization in the Visual Cortex of Cats with Strabismic Amblyopia , 1994, The European journal of neuroscience.

[67]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[68]  B. Motter Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[69]  Marius Usher,et al.  The Effect of Synchronized Inputs at the Single Neuron Level , 1994, Neural Computation.

[70]  William R. Softky,et al.  Simple codes versus efficient codes , 1995, Current Opinion in Neurobiology.

[71]  A. Leventhal,et al.  Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  Pieter R. Roelfsema,et al.  How Precise is Neuronal Synchronization? , 1995, Neural Computation.

[73]  H. Sakata,et al.  Neural mechanisms of visual guidance of hand action in the parietal cortex of the monkey. , 1995, Cerebral cortex.

[74]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[75]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[76]  W. Singer,et al.  Relation between oscillatory activity and long-range synchronization in cat visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[77]  M. Steriade,et al.  Short- and long-range neuronal synchronization of the slow (< 1 Hz) cortical oscillation. , 1995, Journal of neurophysiology.

[78]  J Bullier,et al.  Structural basis of cortical synchronization. II. Effects of cortical lesions. , 1995, Journal of neurophysiology.

[79]  David A. Leopold,et al.  Effects of Binocular Rivalry on Face Cell Activity in Monkey Temporal Cortex , 1995 .

[80]  R. Traub,et al.  Synchronized oscillations in interneuron networks driven by metabotropic glutamate receptor activation , 1995, Nature.

[81]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[82]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[83]  J H Maunsell,et al.  The Brain's Visual World: Representation of Visual Targets in Cerebral Cortex , 1995, Science.

[84]  W. Singer,et al.  Stimulus dependent intercolumnar synchronization of single unit responses in cat area 17. , 1995, Neuroreport.

[85]  P. Somogyi,et al.  Synchronization of neuronal activity in hippocampus by individual GABAergic interneurons , 1995, Nature.

[86]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[87]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[88]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[89]  D. Contreras,et al.  Synchronization of fast (30-40 Hz) spontaneous cortical rhythms during brain activation , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[90]  D. Perrett,et al.  Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. , 1996, Journal of neurophysiology.

[91]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[92]  R. Traub,et al.  Neuronal networks for induced ‘40 Hz’ rhythms , 1996, Trends in Neurosciences.

[93]  W. Singer,et al.  The Role of Neuronal Synchronization in Response Selection: A Biologically Plausible Theory of Structured Representations in the Visual Cortex , 1996, Journal of Cognitive Neuroscience.

[94]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[95]  M. Livingstone Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex. , 1996, Journal of neurophysiology.

[96]  W. Singer,et al.  Stimulus-dependent synchronization of neuronal responses in the visual cortex of the awake macaque monkey , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[97]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[98]  J. Movshon,et al.  Cortical oscillatory responses do not affect visual segmentation , 1996, Vision Research.

[99]  W. Freeman,et al.  Spatiotemporal analysis of prepyriform, visual, auditory, and somesthetic surface EEGs in trained rabbits. , 1996, Journal of neurophysiology.

[100]  D. V. van Essen,et al.  Responses in area V4 depend on the spatial relationship between stimulus and attention. , 1996, Journal of neurophysiology.

[101]  W. Singer,et al.  Role of Reticular Activation in the Modulation of Intracortical Synchronization , 1996, Science.

[102]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[103]  W. Singer,et al.  Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[104]  W Singer,et al.  The Perceptual Grouping Criterion of Colinearity is Reflected by Anisotropies of Connections in the Primary Visual Cortex , 1997, The European journal of neuroscience.

[105]  W. Singer,et al.  Functional Specificity of Long-Range Intrinsic and Interhemispheric Connections in the Visual Cortex of Strabismic Cats , 1997, The Journal of Neuroscience.

[106]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[107]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[108]  W. Singer,et al.  Visuomotor integration is associated with zero time-lag synchronization among cortical areas , 1997, Nature.