Cortical algorithms for perceptual grouping.

A fundamental task of vision is to group the image elements that belong to one object and to segregate them from other objects and the background. This review provides a conceptual framework of how perceptual grouping may be implemented in the visual cortex. According to this framework, two mechanisms are responsible for perceptual grouping: base-grouping and incremental grouping. Base-groupings are coded by single neurons tuned to multiple features, like the combination of a color and an orientation. They are computed rapidly because they reflect the selectivity of feedforward connections. However, not all conceivable feature combinations are coded by dedicated neurons. Therefore, a second, flexible form of grouping is required called incremental grouping. Incremental grouping enhances the responses of neurons coding features that are bound in perception, but it takes more time than does base-grouping because it relies also on horizontal and feedback connections. The modulation of neuronal response strength during incremental grouping has a correlate in psychology because attention is directed to those features that are labeled by the enhanced neuronal response.

[1]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[2]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[3]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[4]  J. Beck.  Effect of orientation and of shape similarity on perceptual grouping , 1966 .

[5]  L. Maffei,et al.  The unresponsive regions of visual cortical receptive fields , 1976, Vision Research.

[6]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[7]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[8]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[9]  J. Duncan.  Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[10]  S. Ullman.  Visual routines , 1984, Cognition.

[11]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[12]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[13]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[14]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[15]  S. Ullman,et al.  Curve tracing: A possible basic operation in the perception of spatial relations , 1986, Memory & cognition.

[16]  Shimon Edelman,et al.  Line connectivity algorithms for an asynchronous pyramid computer , 1987, Comput. Vis. Graph. Image Process..

[17]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[18]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  R. H. Phaf,et al.  SLAM: A connectionist model for attention in visual selection tasks , 1990, Cognitive Psychology.

[20]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[21]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[22]  P. Goldman-Rakic,et al.  Preface: Cerebral Cortex Has Come of Age , 1991 .

[23]  P Jolicoeur,et al.  Size invariance in curve tracing , 1991, Memory & cognition.

[24]  Jitendra Malik,et al.  Detecting Curvilinear Structure in Images , 1991 .

[25]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[26]  M. Peterson,et al.  Shape recognition contributions to figure-ground reversal: which route counts? , 1991, Journal of experimental psychology. Human perception and performance.

[27]  S Ullman,et al.  Low-level aspects of segmentation and recognition. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  H. Nothdurft.  Feature analysis and the role of similarity in preattentive vision , 1992, Perception & psychophysics.

[29]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[30]  D. Perrett,et al.  Time course of neural responses discriminating different views of the face and head. , 1992, Journal of neurophysiology.

[31]  D. Sagi,et al.  Visual attention and perceptual grouping , 1992, Perception & psychophysics.

[32]  S. Palmer.  Common region: A new principle of perceptual grouping , 1992, Cognitive Psychology.

[33]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[34]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[35]  S. Thorpe,et al.  Dynamics of orientation coding in area V1 of the awake primate , 1993, Visual Neuroscience.

[36]  Jeffrey D. Schall,et al.  Neural basis of saccade target selection in frontal eye field during visual search , 1993, Nature.

[37]  E. Miller,et al.  Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus , 1993, Brain Research.

[38]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[39]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[40]  David I. Perrett,et al.  Modeling visual recognition from neurobiological constraints , 1994, Neural Networks.

[41]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[42]  B. Motter.  Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  A. Leventhal,et al.  Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[45]  Victor A. F. Lamme.  The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[47]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[48]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[49]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[50]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[51]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[52]  W Singer,et al.  The Perceptual Grouping Criterion of Colinearity is Reflected by Anisotropies of Connections in the Primary Visual Cortex , 1997, The European journal of neuroscience.

[53]  M. Farah,et al.  Is visual image segmentation a bottom-up or an interactive process? , 1997, Perception & psychophysics.

[54]  Jean Bullier,et al.  The Timing of Information Transfer in the Visual System , 1997 .

[55]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[56]  G A Orban,et al.  Functional impact of cerebral connections. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[58]  Victor A. F. Lamme,et al.  Neuronal synchrony does not represent texture segregation , 1998, Nature.

[59]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[60]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[61]  R Van Rullen,et al.  Face processing using one spike per neurone. , 1998, Bio Systems.

[62]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[63]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[64]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[65]  D. Field,et al.  Integration of contours: new insights , 1999, Trends in Cognitive Sciences.

[66]  Christoph von der Malsburg,et al.  The What and Why of Binding The Modeler’s Perspective , 1999, Neuron.

[67]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[68]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[69]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[70]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[71]  Victor A. F. Lamme,et al.  Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. , 1999, Cerebral cortex.

[72]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[73]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[74]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[75]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[76]  S. Grossberg,et al.  Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex , 2000, Vision Research.

[77]  W H Bosking,et al.  Functional Specificity of Callosal Connections in Tree Shrew Striate Cortex , 2000, The Journal of Neuroscience.

[78]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[79]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[80]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[81]  F. van der Velde,et al.  From Knowing What to Knowing Where: Modeling Object-Based Attention with Feedback Disinhibition of Activation , 2001, Journal of Cognitive Neuroscience.

[82]  T Moore,et al.  Control of eye movements and spatial attention. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Pieter R. Roelfsema,et al.  The Representation of Erroneously Perceived Stimuli in the Primary Visual Cortex , 2001, Neuron.

[84]  F. Velde,et al.  From Knowing What to Knowing Where: Modeling Object-Based Attention with Feedback Disinhibition of Activation , 2001 .

[85]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[86]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[87]  Roman Bauer,et al.  Contour integration in striate cortex , 2002, Experimental Brain Research.

[88]  R. Goebel,et al.  The role of feedback in shaping neural representations in cat visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[89]  T. Albright,et al.  Contextual influences on visual processing. , 2002, Annual review of neuroscience.

[90]  Christof Koch,et al.  Single-neuron correlates of subjective vision in the human medial temporal lobe , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[91]  J. Duncan,et al.  Filtering of neural signals by focused attention in the monkey prefrontal cortex , 2002, Nature Neuroscience.

[92]  A. Thiele,et al.  Neuronal synchrony does not correlate with motion coherence in cortical area MT , 2003, Nature.

[93]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[94]  H. Spekreijse,et al.  A gradual spread of attention during mental curve tracing. , 2003, Perception & psychophysics.

[95]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[96]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[97]  Victor A. F. Lamme,et al.  Synchrony and covariation of firing rates in the primary visual cortex during contour grouping , 2004, Nature Neuroscience.

[98]  C. Gilbert,et al.  Perceptual learning and top-down influences in primary visual cortex , 2004, Nature Neuroscience.

[99]  J. Nelson,et al.  Intracortical facilitation among co-oriented, co-axially aligned simple cells in cat striate cortex , 2004, Experimental Brain Research.

[100]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.

[101]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[102]  F. Hamker.  The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. , 2005, Cerebral cortex.

[103]  G. DeAngelis,et al.  Does Neuronal Synchrony Underlie Visual Feature Grouping? , 2005, Neuron.

[104]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[105]  Lawrence C. Sincich,et al.  The circuitry of V1 and V2: integration of color, form, and motion. , 2005, Annual review of neuroscience.

[106]  Harrison H. Barrett,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.

[107]  Robert Desimone,et al.  Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4 , 2005, Science.

[108]  J. Gallant,et al.  Complete functional characterization of sensory neurons by system identification. , 2006, Annual review of neuroscience.

[109]  Acknowledgments , 2006, Molecular and Cellular Endocrinology.

[110]  S. Hyman,et al.  Neural mechanisms of addiction: the role of reward-related learning and memory. , 2006, Annual review of neuroscience.

[111]  S. Cannon.  Pathomechanisms in channelopathies of skeletal muscle and brain. , 2006, Annual review of neuroscience.