Neural Computation of Surface Border Ownership and Relative Surface Depth from Ambiguous Contrast Inputs

The segregation of image parts into foreground and background is an important aspect of the neural computation of 3D scene perception. To achieve such segregation, the brain needs information about border ownership; that is, the belongingness of a contour to a specific surface represented in the image. This article presents psychophysical data derived from 3D percepts of figure and ground that were generated by presenting 2D images composed of spatially disjoint shapes that pointed inward or outward relative to the continuous boundaries that they induced along their collinear edges. The shapes in some images had the same contrast (black or white) with respect to the background gray. Other images included opposite contrasts along each induced continuous boundary. Psychophysical results demonstrate conditions under which figure-ground judgment probabilities in response to these ambiguous displays are determined by the orientation of contrasts only, not by their relative contrasts, despite the fact that many border ownership cells in cortical area V2 respond to a preferred relative contrast. Studies are also reviewed in which both polarity-specific and polarity-invariant properties obtain. The FACADE and 3D LAMINART models are used to explain these data.

[1]  Branka Spehar,et al.  Created unequal: Temporal dynamics of modal and amodal boundary interpolation , 2016, Vision Research.

[2]  S. Grossberg Cortical Dynamics of Figure-Ground Separation in Response to 2D Pictures and 3D Scenes: How V2 Combines Border Ownership, Stereoscopic Cues, and Gestalt Grouping Rules , 2016, Front. Psychol..

[3]  Birgitta Dresp-Langley,et al.  Principles of perceptual grouping: implications for image-guided surgery , 2015, Front. Psychol..

[4]  R. Shapley,et al.  Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception. , 2015, Journal of vision.

[5]  Birgitta Dresp-Langley,et al.  2D Geometry Predicts Perceived Visual Curvature in Context-Free Viewing , 2015, Comput. Intell. Neurosci..

[6]  L. Spillmann,et al.  Beyond the classical receptive field: The effect of contextual stimuli. , 2015, Journal of vision.

[7]  S. Grossberg,et al.  Binocular fusion and invariant category learning due to predictive remapping during scanning of a depthful scene with eye movements , 2015, Front. Psychol..

[8]  O. Braddick,et al.  Reviews: The New Visual Neurosciences, Galileo's Visions: Piercing the Spheres of the Heavens by Eye and Mind , 2014 .

[9]  S. Grossberg How visual illusions illuminate complementary brain processes: illusory depth from brightness and apparent motion of illusory contours , 2014, Front. Hum. Neurosci..

[10]  Birgitta Dresp-Langley,et al.  Effects of saturation and contrast polarity on the figure-ground organization of color on gray , 2014, Front. Psychol..

[11]  S. Grossberg,et al.  Where’s Waldo? How perceptual, cognitive, and emotional brain processes cooperate during learning to categorize and find desired objects in a cluttered scene , 2014, Front. Integr. Neurosci..

[12]  M. Piccolino,et al.  Galileo's Visions: Piercing the spheres of the heavens by eye and mind , 2013 .

[13]  Stephen Grossberg,et al.  Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world , 2013, Neural Networks.

[14]  Nicholas C. Foley,et al.  Neural Dynamics of Object-based Multifocal Visual Spatial Attention and Priming: Object Cueing, Useful-field-of-view, and Crowding Cognitive Psychology , 2012 .

[15]  Stephen Grossberg,et al.  Stereopsis and 3D surface perception by spiking neurons in laminar cortical circuits: A method for converting neural rate models into spiking models , 2012, Neural Networks.

[16]  Birgitta Dresp-Langley,et al.  Simultaneous brightness and apparent depth from true colors on grey: Chevreul revisited. , 2012, Seeing and perceiving.

[17]  S. Grossberg,et al.  Neural Dynamics of Gestalt Principles of Perceptual Organization : From Grouping to Shape and Meaning 1 , 2012 .

[18]  Stephen Grossberg,et al.  How does the brain rapidly learn and reorganize view-invariant and position-invariant object representations in the inferotemporal cortex? , 2011, Neural Networks.

[19]  Stephen Grossberg,et al.  On the road to invariant object recognition: How cortical area V2 transforms absolute to relative disparity during 3D vision , 2011, Neural Networks.

[20]  R. von der Heydt,et al.  Representation of object continuity in the visual cortex. , 2011, Journal of vision.

[21]  S. Grossberg,et al.  How Does the Brain Rapidly Learn and Reorganize View- and Positionally-Invariant Object Representations in Inferior Temporal Cortex? , 2011 .

[22]  Zijiang J. He,et al.  Boundary contour-based surface integration affected by color , 2010, Vision Research.

[23]  R. von der Heydt,et al.  Analysis of the Context Integration Mechanisms Underlying Figure–Ground Organization in the Visual Cortex , 2010, The Journal of Neuroscience.

[24]  Stephen Grossberg,et al.  A laminar cortical model of stereopsis and 3D surface perception of complex natural scenes , 2010 .

[25]  Stephen Grossberg,et al.  Running as fast as it can: How spiking dynamics form object groupings in the laminar circuits of visual cortex , 2010, Journal of Computational Neuroscience.

[26]  Stephen Grossberg,et al.  Cortical dynamics of navigation and steering in natural scenes: Motion-based object segmentation, heading, and obstacle avoidance , 2009, Neural Networks.

[27]  S. Grossberg Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion and action , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Rüdiger von der Heydt,et al.  Short-Term Memory for Figure-Ground Organization in the Visual Cortex , 2009, Neuron.

[29]  S. Grossberg,et al.  View-invariant object category learning, recognition, and search: How spatial and object attention are coordinated using surface-based attentional shrouds , 2009, Cognitive Psychology.

[30]  D. Kersten,et al.  Border Ownership Selectivity in Human Early Visual Cortex and its Modulation by Attention , 2009, The Journal of Neuroscience.

[31]  S. Grossberg,et al.  From stereogram to surface: how the brain sees the world in depth. , 2009, Spatial vision.

[32]  B. Spehar,et al.  The perception of illusory transparent surfaces in infancy: early emergence of sensitivity to static pictorial cues. , 2008, Journal of vision.

[33]  Stephen Grossberg,et al.  How does binocular rivalry emerge from cortical mechanisms of 3-D vision? , 2008, Vision Research.

[34]  F. Qiu,et al.  Figure-ground mechanisms provide structure for selective attention , 2007, Nature Neuroscience.

[35]  S. Grossberg,et al.  Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception. , 2007, Spatial vision.

[36]  Stephen Grossberg,et al.  Logic and phenomenology of incompleteness in illusory figures: New cases and hypotheses , 2006 .

[37]  S. Grossberg,et al.  A neural model of surface perception: lightness, anchoring, and filling-in. , 2006, Spatial vision.

[38]  F. Qiu,et al.  Figure and Ground in the Visual Cortex: V2 Combines Stereoscopic Cues with Gestalt Rules , 2005, Neuron.

[39]  S. Grossberg,et al.  Laminar cortical dynamics of 3D surface perception: Stratification, transparency, and neon color spreading , 2005, Vision Research.

[40]  P. Tse Voluntary attention modulates the brightness of overlapping transparent surfaces , 2005, Vision Research.

[41]  Birgitta Dresp,et al.  Long-range spatial integration across contrast signs: a probabilistic mechanism? , 2005, Vision Research.

[42]  Stephen Grossberg,et al.  A laminar cortical model of stereopsis and 3D surface perception: closure and da Vinci stereopsis. , 2004, Spatial vision.

[43]  Stephen Grossberg,et al.  Fast synchronization of perceptual grouping in laminar visual cortical circuits , 2004, Neural Networks.

[44]  Stephen Grossberg,et al.  A laminar cortical model for 3D perception of slanted and curved surfaces and of 2D images: development, attention, and bistability , 2004, Vision Research.

[45]  K. Prazdny,et al.  Some new phenomena in the perception of glass patterns , 2004, Biological Cybernetics.

[46]  Branka Spehar,et al.  When does illusory contour formation depend on contrast polarity? , 2003, Vision Research.

[47]  S. Grossberg,et al.  A laminar cortical model of stereopsis and three-dimensional surface perception , 2003, Vision Research.

[48]  Tzvetomir Tzvetanov,et al.  Short- and long-range effects in line contrast integration , 2002, Vision Research.

[49]  Stephen Grossberg,et al.  Depth perception from pairs of overlapping cues in pictorial displays. , 2002, Spatial vision.

[50]  Birgitta Dresp,et al.  Asymmetrical contrast effects induced by luminance and color configurations , 2001, Perception & psychophysics.

[51]  Stephen Grossberg,et al.  Neural dynamics of motion integration and segmentation within and across apertures , 2001, Vision Research.

[52]  S. Grossberg,et al.  Neural dynamics of 3-D surface perception: Figure-ground separation and lightness perception , 2000, Perception & psychophysics.

[53]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[54]  B. Spehar Degraded illusory contour formation with non-uniform inducers in Kanizsa configurations: the role of contrast polarity , 2000, Vision Research.

[55]  Hong Zhou,et al.  Representation of stereoscopic edges in monkey visual cortex , 2000, Vision Research.

[56]  Stephen Grossberg,et al.  Spatial facilitation by color and luminance edges: boundary, surface, and attentional factors 1 Supported in part by Defense Advanced Research Projects Agency and the Office of Naval Research (ONR N00014-95-1-0409 and ONR N00014-95-1-0657). 1 , 1999, Vision Research.

[57]  E. Adelson Lightness Perception and Lightness Illusions , 1999 .

[58]  S. Grossberg How does the cerebral cortex work? Learning, attention, and grouping by the laminar circuits of visual cortex. , 1999, Spatial vision.

[59]  Zijiang J. He,et al.  Illusory-Contour Formation Affected by Luminance Contrast Polarity , 1998, Perception.

[60]  C. Wehrhahn,et al.  Detection facilitation by collinear stimuli in humans: Dependence on strength and sign of contrast , 1998, Vision Research.

[61]  S. Grossberg,et al.  Cortical computation of stereo disparity , 1998, Vision Research.

[62]  Stephen Grossberg,et al.  Cortical dynamics of three-dimensional surface perception: Binocular and half-occluded scenic images , 1997, Neural Networks.

[63]  L. Welch,et al.  The Effect of Inducer Polarity and Contrast on the Perception of Illusory Figures , 1997, Perception.

[64]  S. Grossberg Cortical dynamics of three-dimensional figure-ground perception of two-dimensional pictures. , 1997, Psychological review.

[65]  C. Gilbert,et al.  Cortical dynamics , 1997, Acta paediatrica (Oslo, Norway : 1992). Supplement.

[66]  B. Anderson A Theory of Illusory Lightness and Transparency in Monocular and Binocular Images: The Role of Contour Junctions , 1997, Perception.

[67]  S. Grossberg,et al.  Contour Integration Across Polarities and Spatial Gaps: From Local Contrast Filtering to Global Grouping , 1997, Vision Research.

[68]  Birgitta Dresp,et al.  On illusory contours and their functional significance , 1997 .

[69]  U. Polat,et al.  Neurophysiological Evidence for Contrast Dependent Long-range Facilitation and Suppression in the Human Visual Cortex , 1996, Vision Research.

[70]  C Bonnet,et al.  Illusory form with inducers of opposite contrast polarity: Evidence for multistage integration , 1996, Perception & psychophysics.

[71]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[72]  S. Grossberg,et al.  Cortical Dynamics of 3-D Surface Perception: Binocular and Half-Occluded Scenic Images , 1995 .

[73]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[74]  D. Sutherland,et al.  On the road. , 1996, Nursing times.

[75]  Takeo Watanabe,et al.  Transparent surfaces defined by implicit X junctions , 1993, Vision Research.

[76]  P. Cavanagh,et al.  Surface decomposition accompanying the perception of transparency. , 1993, Spatial vision.

[77]  Stephen Grossberg,et al.  Preattentive texture segmentation and grouping by the boundary contour system , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[78]  S. Grossberg,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1991 .

[79]  Shinsuke Shimojo,et al.  Da vinci stereopsis: Depth and subjective occluding contours from unpaired image points , 1990, Vision Research.

[80]  S. Grossberg,et al.  Neural dynamics of 1-D and 2-D brightness perception: A unified model of classical and recent phenomena , 1988, Perception & psychophysics.

[81]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[82]  S. Grossberg Cortical dynamics of three-dimensional form, color, and brightness perception: I. Monocular theory , 1987, Perception & psychophysics.

[83]  G. Westheimer,et al.  Spatial location and hyperacuity: The centre/surround localization contribution function has two substrates , 1985, Vision Research.

[84]  G. Kanizsa Seeing and thinking. , 1985, Acta psychologica.

[85]  K. Prazdny On the nature of inducing forms generating perceptions of illusory contours , 1985, Perception & psychophysics.

[86]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[87]  S Grossberg,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985, Perception & psychophysics.

[88]  G. Westheimer,et al.  Spatial location and hyperacuity: flank position within the centre and surround zones. , 1985, Spatial vision.

[89]  J Gordon,et al.  Nonlinearity in the perception of form , 1985, Perception & psychophysics.

[90]  D. G. Albrecht,et al.  Spatial mapping of monkey VI cells with pure color and luminance stimuli , 1984, Vision Research.

[91]  Richard I. Ivry,et al.  The perception of transparency with achromatic colors , 1984, Perception & psychophysics.

[92]  Stephen Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & psychophysics.

[93]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[94]  S. Grossberg Outline of A Theory of Brightness, Color, and form Perception , 1984 .

[95]  K Prazdny,et al.  Illusory contours are not caused by simultaneous brightness contrast , 1983, Perception & psychophysics.

[96]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[97]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[98]  G. Kanizsa Subjective contours. , 1976, Scientific American.

[99]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[100]  R. Pérez,et al.  Perception of Random Dot Interference Patterns , 1973, Nature.

[101]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[102]  Brown Wl,et al.  Recency, frequency, and probability in response prediction. , 1957 .

[103]  J. Overall,et al.  Recency, frequency, and probability in response prediction. , 1957, Psychological review.

[104]  G. Kanizsa Margini Quasi-percettivi in Campi con Stimolazione Omogenea , 1955 .

[105]  Edgar Rubin Visuell wahrgenommene Figuren : Studien in psychologischer Analyse , 1921 .