Visual Feature Binding within the Selective Tuning Attention Framework

We present a biologically plausible computational model for solving the visual feature binding problem, based on recent results regarding the time course and processing sequence in the primate visual system. The feature binding problem appears due to the distributed nature of visual processing in the primate brain, and the gradual loss of spatial information along the processing hierarchy. This paper puts forward the proposal that by using multiple passes of the visual processing hierarchy, both bottom-up and top-down, and using task information to tune the processing prior to each pass, we can explain the different recognition behaviors that primate vision exhibits. To accomplish this, four different kinds of binding processes are introduced and are tied directly to specific recognition tasks and their time course. The model relies on the reentrant connections so ubiquitous in the primate brain to recover spatial information, and thus allow features represented in different parts of the brain to be integrated in a unitary conscious percept. We show how different tasks and stimuli have different binding requirements, and present a unified framework within the Selective Tuning model of visual attention.

[1]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[2]  John K. Tsotsos,et al.  Attention links sensing to recognition , 2008, Image Vis. Comput..

[3]  P. Rabbitt,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption , 1989 .

[4]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[5]  S. Tipper,et al.  Inhibitory Mechanisms of Neural and Cognitive Control: Applications to Selective Attention and Sequential Action , 1996, Brain and Cognition.

[6]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[7]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[8]  John K. Tsotsos,et al.  Towards a Biologically Plausible Active Visual Search Model , 2004, WAPCV.

[9]  G. Shulman,et al.  Moving attention through visual space. , 1979, Journal of experimental psychology. Human perception and performance.

[10]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[11]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[12]  Geoffrey M. Ghose,et al.  Specialized Representations in Visual Cortex A Role for Binding? , 1999, Neuron.

[13]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[14]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[15]  H. Barlow,et al.  Single Units and Sensation: A Neuron Doctrine for Perceptual Psychology? , 1972, Perception.

[16]  John K. Tsotsos,et al.  Selective Tuning: Feature Binding Through Selective Attention , 2006, ICANN.

[17]  John K. Tsotsos,et al.  Attending to visual motion , 2005, Comput. Vis. Image Underst..

[18]  D. Norman Toward a theory of memory and attention. , 1968 .

[19]  E Legallet,et al.  Orientation spatiale de l’attention : étude des temps de réaction lors du mouvement de pointage , 2002, Neurophysiologie Clinique/Clinical Neurophysiology.

[20]  Kunihiko Fukushima,et al.  Character recognition with selective attention , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[21]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[22]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[23]  John K. Tsotsos,et al.  Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[24]  C. R. Snyder Selection, inspection, and naming in visual search. , 1972, Journal of experimental psychology.

[25]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[26]  A. Treisman,et al.  Perception of objects in natural scenes: is it really attention free? , 2005, Journal of experimental psychology. Human perception and performance.

[27]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[28]  P. Milner A model for visual shape recognition. , 1974, Psychological review.

[29]  Klaus-Peter Hoffmann,et al.  Arm movement and gap as factors influencing the reaction time of the second saccade in a double‐step task , 2003, The European journal of neuroscience.

[30]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[31]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[32]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[33]  Kunihiko Fukushima,et al.  A neural network model for selective attention in visual pattern recognition , 1986, Biological Cybernetics.

[34]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[35]  C. Malsburg Nervous Structures with Dynamical Links , 1985 .

[36]  N. Kanwisher,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Recognition As Soon as You Know It Is There, You Know What It Is , 2022 .

[37]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[38]  D. Broadbent Perception and communication , 1958 .

[39]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[40]  H. C. Nothdurft,et al.  Texture segmentation and pop-out from orientation contrast , 1991, Vision Research.

[41]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[42]  John K. Tsotsos,et al.  Different Binding Strategies for the Different Stages of Visual Recognition , 2007, BVAI.

[43]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[44]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[45]  S. Zeki Uniformity and diversity of structure and function in rhesus monkey prestriate visual cortex. , 1978, The Journal of physiology.

[46]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[47]  John K. Tsotsos,et al.  Modeling the Dynamics of Feature Binding During Object-Selective Attention , 2008, WAPCV.

[48]  John K. Tsotsos Hierarchical , Localized Saliency Computations Solve the Visual Feature Binding Problem , 2004 .

[49]  C. von der Malsburg The what and why of binding: the modeler's perspective. , 1999, Neuron.

[50]  J-M Hopf,et al.  Dynamics of feature binding during object-selective attention , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[51]  A. Treisman THE EFFECT OF IRRELEVANT MATERIAL ON THE EFFICIENCY OF SELECTIVE LISTENING. , 1964, The American journal of psychology.

[52]  C. Schroeder,et al.  Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. , 2000, Cerebral cortex.

[53]  John K. Tsotsos,et al.  Attention and Visual Search: Active Robotic Vision Systems that Search , 2007 .

[54]  H. J. Muller,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. , 1989, Journal of experimental psychology. Human perception and performance.

[55]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[56]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[57]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.