The “side” matters: How configurality is reflected in completion

The perception of figure-ground organization is a highly context-sensitive phenomenon. Accumulating evidence suggests that the so-called completion phenomenon is tightly linked to this figure-ground organization. While many computational models have applied borderline completion algorithms based on the detection of boundary alignments, we point out the problems of this approach. We hypothesize that completion is a result of computing the figure-ground organization. Specifically, the global interactions in the neural network activate the “border-ownership” sensitive neurons at the location where no luminance contrast is given and this activation corresponds to the perception of illusory contours. The implications of this result to the general property of emerging Gestalt percepts are discussed.

[1]  Allen R. Hanson,et al.  Perceptual completion of occluded surfaces , 1996, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  G. Kanizsa,et al.  Can We See Constructs , 1987 .

[3]  M K Albert,et al.  Parallelism and the Perception of Illusory Contours , 1993, Perception.

[4]  Li Zhaoping,et al.  Border Ownership from Intracortical Interactions in Visual Area V2 , 2005, Neuron.

[5]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Heiko Neumann,et al.  Globally consistent depth sorting of overlapping 2D surfaces in a model using local recurrent interactions , 2008, Biological Cybernetics.

[7]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[8]  M. Peterson,et al.  Inhibitory competition in figure-ground perception: context and convexity. , 2008, Journal of vision.

[9]  Leif H. Finkel,et al.  Simulating biological vision with hybrid neural networks , 1992, Simul..

[10]  B. Julesz,et al.  A THEORETICAL ANALYSIS OF ILLUSORY CONTOUR FORMATION IN STEREOPSIS , 1995 .

[11]  C. Strecha,et al.  Surface construction by a 2-D differentiation-integration process: a neurocomputational model for perceived border ownership, depth, and lightness in Kanizsa figures. , 2010, Psychological review.

[12]  C Fantoni,et al.  Retinal Size, Visual Attention, and Contour Interpolation , 2002 .

[13]  Brian A. Wandell,et al.  Predominantly extra-retinotopic cortical response to pattern symmetry , 2005, NeuroImage.

[14]  Rüdiger von der Heydt,et al.  The speed of context integration in the visual cortex. , 2011, Journal of neurophysiology.

[15]  Pieter R. Roelfsema,et al.  Boundary assignment in a recurrent network architecture , 2007, Vision Research.

[16]  S Grossberg,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985, Perception & psychophysics.

[17]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1997, Neural Computation.

[18]  Walter Gerbino,et al.  Visual interpolation is not scale invariant , 2006, Vision Research.

[19]  N. Rubin,et al.  fMRI Activation in Response to Illusory Contours and Salient Regions in the Human Lateral Occipital Complex , 2003, Neuron.

[20]  K Nakayama,et al.  Stereoscopic Depth: Its Relation to Image Segmentation, Grouping, and the Recognition of Occluded Objects , 1989, Perception.

[21]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[22]  Marco Sambin,et al.  A Dynamic Model of Anomalous Figures , 1987 .

[23]  P. Kellman,et al.  Surface interpolation and 3D relatability. , 2008, Journal of vision.

[24]  Nava Rubin,et al.  Salient and multiple illusory surfaces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  B. Gulyás,et al.  Neuronal correlates of real and illusory contour perception: functional anatomy with PET , 1999, The European journal of neuroscience.

[26]  R Shapley,et al.  Illusory contours activate specific regions in human visual cortex: evidence from functional magnetic resonance imaging. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[27]  L. Gool,et al.  Linking depth to lightness and anchoring within the differentiation–integration formalism , 2010, Vision Research.

[28]  Zijiang J. He,et al.  Surfaces versus features in visual search , 1992, Nature.

[29]  Peter Ulric Tse,et al.  Volume Completion , 1999, Cognitive Psychology.

[30]  F. Kruggel,et al.  Hemodynamic and Electroencephalographic Responses to Illusory Figures: Recording of the Evoked Potentials during Functional MRI , 2001, NeuroImage.

[31]  A reply to Kogo and Wagemans , 2011 .

[32]  R. Fleming,et al.  The Interpolation of Object and Surface Structure , 2002, Cognitive Psychology.

[33]  M Dojat,et al.  Moving illusory contours activate primary visual cortex: an fMRI study. , 2000, Cerebral cortex.

[34]  R. von der Heydt,et al.  Analysis of the Context Integration Mechanisms Underlying Figure–Ground Organization in the Visual Cortex , 2010, The Journal of Neuroscience.

[35]  D. Kersten,et al.  Border Ownership Selectivity in Human Early Visual Cortex and its Modulation by Attention , 2009, The Journal of Neuroscience.

[36]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[37]  R. von der Heydt,et al.  A neural model of figure-ground organization. , 2007, Journal of neurophysiology.

[38]  Esther Peterhans,et al.  Stereoscopic Illusory ContoursCortical Neuron Responses and Human Perception , 2002, Journal of Cognitive Neuroscience.

[39]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[40]  Janine Mendola Contextual Shape Processing in Human Visual Cortex: Beginning to Fill-In the Blanks , 2003 .

[41]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[42]  Michael J. Hawken,et al.  Macaque VI neurons can signal ‘illusory’ contours , 1993, Nature.

[43]  Manish Singh,et al.  A Bayesian Framework for Figure-Ground Interpretation , 2010, NIPS.

[44]  Philip J. Kellman,et al.  A unified model of illusory and occluded contour interpolation , 2010, Vision Research.

[45]  R. O’Reilly,et al.  Figure-ground organization and object recognition processes: an interactive account. , 1998, Journal of experimental psychology. Human perception and performance.

[46]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[47]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[48]  C. Herrmann,et al.  Gestalt perception modulates early visual processing , 2001, Neuroreport.

[49]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. II. Contours bridging gaps , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  B. Anderson Filling-in models of completion: rejoinder to Kellman, Garrigan, Shipley, and Keane (2007) and Albert (2007). , 2007, Psychological review.

[52]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[53]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[54]  Bradley S Gibson,et al.  Directing spatial attention within an object: altering the functional equivalence of shape descriptions. , 1991, Journal of experimental psychology. Human perception and performance.

[55]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[56]  W. Gerbino,et al.  Contour interpolation by vector-field combination. , 2003, Journal of vision.

[57]  F. Qiu,et al.  Figure-ground mechanisms provide structure for selective attention , 2007, Nature Neuroscience.

[58]  C. Hung,et al.  Real and illusory contour processing in area V1 of the primate: a cortical balancing act. , 2001, Cerebral cortex.

[59]  Walter Gerbino,et al.  Probing the amodal completion of asymmetrically occluded angles: A test of interpolation models , 2010 .

[60]  Elizabeth Salvagio,et al.  Competition-strength-dependent ground suppression in figure–ground perception , 2012, Attention, perception & psychophysics.

[61]  Eric Halgren,et al.  Cortical activation to illusory shapes as measured with magnetoencephalography , 2003, NeuroImage.

[62]  Gereon R. Fink,et al.  Functional anatomy and differential time courses of neural processing for explicit, inferred, and illusory contours An event-related fMRI study , 2003, NeuroImage.

[63]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[64]  Mary A Peterson,et al.  Inhibitory competition between shape properties in figure-ground perception. , 2008, Journal of experimental psychology. Human perception and performance.

[65]  R. L. Gregory,et al.  Illusory contours and stereo depth , 1974 .

[66]  R. Watt,et al.  The utility of image descriptions in the initial stages of vision: a case study of printed text. , 2010, British journal of psychology.

[67]  S. Coren,et al.  SUBJECTIVE CONTOURS AND APPARENT DEPTH , 2005 .

[68]  M. Seghier,et al.  Functional Neuroimaging Findings on the Human Perception of Illusory Contours , 2022 .

[69]  J. Wagemans,et al.  Switching dynamics of border ownership: A stochastic model for bi-stable perception , 2011, Vision Research.

[70]  B. Gibson,et al.  Object recognition contributions to figure-ground organization: Operations on outlines and subjective contours , 1994, Perception & psychophysics.

[71]  Shinsuke Shimojo,et al.  Visual surface representation: a critical link between lower-level and higher level vision , 1995 .

[72]  F. M.,et al.  The Concise Oxford Dictionary of Current English , 1929, Nature.

[73]  L. Zhaoping,et al.  V1 mechanisms and some figure–ground and border effects , 2003, Journal of Physiology-Paris.

[74]  P. Kellman,et al.  Perception of Partly Occluded Objects and Illusory Figures : Evidence for an Identity Hypothesis , 2004 .

[75]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[76]  S. Zeki,et al.  Brain Activity Related to the Perception of Illusory Contours , 1996, NeuroImage.

[77]  S. Sutherland Eye, brain and vision , 1993, Nature.

[78]  Lauri Parkkonen,et al.  Early visual brain areas reflect the percept of an ambiguous scene , 2008, Proceedings of the National Academy of Sciences.

[79]  Victor A. F. Lamme,et al.  Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. , 1999, Cerebral cortex.

[80]  Hans Supèr,et al.  Feed-Forward Segmentation of Figure-Ground and Assignment of Border-Ownership , 2010, PloS one.

[81]  F. Qiu,et al.  Figure and Ground in the Visual Cortex: V2 Combines Stereoscopic Cues with Gestalt Rules , 2005, Neuron.

[82]  W. Gerbino,et al.  Contour curvature polarity and surface interpolation , 2005, Vision Research.

[83]  Friedrich Heitger,et al.  Simulation of Neuronal Responses Defining Depth Order and Contrast Polarity at Illusory Contours in Monkey Area V2 , 2001, Journal of Computational Neuroscience.

[84]  A. Dale,et al.  The Representation of Illusory and Real Contours in Human Cortical Visual Areas Revealed by Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[85]  M. Sur,et al.  Orientation Maps of Subjective Contours in Visual Cortex , 1996, Science.

[86]  J. Enns,et al.  The edge complex: Implicit memory for figure assignment in shape perception , 2005, Perception & psychophysics.

[87]  Mary A Peterson,et al.  Implicit memory for novel figure-ground displays includes a history of cross-border competition. , 2003, Journal of experimental psychology. Human perception and performance.

[88]  P U Tse,et al.  Complete mergeability and amodal completion. , 1999, Acta psychologica.

[89]  Manish Singh Modal and Amodal Completion Generate Different Shapes , 2004, Psychological science.

[90]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[91]  K Nakayama,et al.  Toward a neural understanding of visual surface representation. , 1990, Cold Spring Harbor symposia on quantitative biology.

[92]  Danique Jeurissen,et al.  The Time Course of Perceptual Grouping in Natural Scenes , 2012, Psychological science.

[93]  K Nakayama,et al.  Experiencing and perceiving visual surfaces. , 1992, Science.

[94]  Rüdiger von der Heydt,et al.  Simulation of neural contour mechanisms: representing anomalous contours , 1998, Image Vis. Comput..

[95]  Jacqueline M. Fulvio,et al.  Surface geometry influences the shape of illusory contours. , 2006, Acta psychologica.

[96]  J. Wagemans,et al.  What is required for a signal to be qualified as a 'grouping' tag? , 2011, British journal of psychology.

[97]  W. Singer,et al.  The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery , 1998, The European journal of neuroscience.

[98]  G. Kanizsa Margini Quasi-percettivi in Campi con Stimolazione Omogenea , 1955 .

[99]  M. Peterson,et al.  Shape recognition contributions to figure-ground reversal: which route counts? , 1991, Journal of experimental psychology. Human perception and performance.

[100]  E. Peterhans,et al.  Figure‐Ground Segregation at Contours: a Neural Mechanism in the Visual Cortex of the Alert Monkey , 1997, The European journal of neuroscience.

[101]  Alice Mado Proverbio,et al.  Electrophysiological indexes of illusory contours perception in humans , 2002, Neuropsychologia.

[102]  Geoffrey E. Hinton,et al.  Separating Figure from Ground with a Parallel Network , 1986, Perception.

[103]  H. Neumann,et al.  The Role of Attention in Figure-Ground Segregation in Areas V1 and V4 of the Visual Cortex , 2012, Neuron.

[104]  Leif H. Finkel,et al.  Object Discrimination Based on Depth-from-Occlusion , 1992, Neural Computation.

[105]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[106]  A. Michotte,et al.  Les compléments amodaux des structures perceptives , 1964 .