Serial versus parallel processing in mid-level vision: filling-in the details of spatial interpolation

Abstract The relationship between boundary completion and surface filling-in, two core mechanisms of mid-level vision, remains unclear. Here, we integrate recent empirical findings to shine new light onto the neural mechanisms of boundary completion and surface filling-in as well as their relation to each other. Specifically, we discuss several psychophysical and neurophysiological studies that, when taken together, support a model where object boundaries and visual surfaces are interpolated in parallel, with one process impacting the other. We suggest that visual boundary completion and surface filling-in are two interacting processes that are supported by neural processes that are distributed throughout several areas of the early visual system.

[1]  R. Lotto,et al.  Responses of human visual cortex to uniform surfaces , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Georgios A. Keliris,et al.  The Role of the Primary Visual Cortex in Perceptual Suppression of Salient Visual Stimuli , 2010, The Journal of Neuroscience.

[3]  J. Bullier,et al.  Parallel versus serial processing: new vistas on the distributed organization of the visual system , 1995, Current Opinion in Neurobiology.

[4]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[5]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[6]  S. Anstis.  Contour adaptation. , 2013, Journal of vision.

[7]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[8]  S. Sutherland.  Eye, brain and vision , 1993, Nature.

[9]  H. F. van Tuijl.  A new visual illusion: neonlike color spreading and complementary color induction between subjective contours. , 1975, Acta psychologica.

[10]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[11]  Pieter R. Roelfsema,et al.  Distinct Roles of the Cortical Layers of Area V1 in Figure-Ground Segregation , 2013, Current Biology.

[12]  Y Kamitani,et al.  Afterimage of Perceptually Filled-in Surface , 2001, Science.

[13]  Stephen Grossberg,et al.  Filling-in the Forms: Surface and Boundary Interactions in Visual Cortex , 1998 .

[14]  In-Seuck Jeung,et al.  Investigation of the pseudo-shock wave in a two-dimensional supersonic inlet , 2010, J. Vis..

[15]  W. Metzger.  Optische Untersuchungen am Ganzfeld , 1930 .

[16]  Jeremy M. Wolfe,et al.  Sensation and Perception , 2008 .

[17]  J. Gibson.  The perception of visual surfaces. , 1950, The American journal of psychology.

[18]  Vivian O'Brien.  Contrast by Contour-Enhancement , 1959 .

[19]  Leslie G. Ungerleider,et al.  Perceptual filling-in: a parametric study , 1998, Vision Research.

[20]  Laurent Itti,et al.  Computational modeling and exploration of contour integration for visual saliency , 2005, Biological Cybernetics.

[21]  Richard C Saunders,et al.  Receptive field focus of visual area V4 neurons determines responses to illusory surfaces , 2013, Proceedings of the National Academy of Sciences.

[22]  Stuart Anstis,et al.  Filling-in afterimage colors between the lines , 2009, Current Biology.

[23]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[24]  John M. Kennedy,et al.  Drawing and the Blind: Pictures to Touch , 1993 .

[25]  H. V. Tuijl,et al.  A new visual illusion: Neonlike color spreading and complementary color induction between subjective contours , 1975 .

[26]  J. Gallant,et al.  A Human Extrastriate Area Functionally Homologous to Macaque V4 , 2000, Neuron.

[27]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[28]  H. Komatsu,et al.  Surface representation in the visual system. , 1996, Brain research. Cognitive brain research.

[29]  R. Blake,et al.  Sustained perceptual invisibility of solid shapes following contour adaptation to partial outlines , 2014, Consciousness and Cognition.

[30]  Naoki Kogo,et al.  The emergent property of border-ownership and the perception of illusory surfaces in a dynamic hierarchical system , 2013, Cognitive neuroscience.

[31]  C. Connor,et al.  Population coding of shape in area V4 , 2002, Nature Neuroscience.

[32]  Kennehi J. W. Craik,et al.  THE NATURE OF PSYCHOLOGY: A SELECTION OF PAPERS, ESSAYS AND OTHER WRITINGS , 1966 .

[33]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[34]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[35]  B. Pinna,et al.  Surface color from boundaries: a new ‘watercolor’ illusion , 2001, Vision Research.

[36]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.

[37]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[38]  Sudeep Sarkar,et al.  Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Johan Wagemans,et al.  Integration of contour and surface information in shape detection , 2011, Vision Research.

[40]  J. Gallant,et al.  Spectral receptive field properties explain shape selectivity in area V4. , 2006, Journal of neurophysiology.

[41]  Max Wertheimer,et al.  Untersuchungen zur Lehre von der Gestalt , .

[42]  G. Kanizsa.  Subjective contours. , 1976, Scientific American.

[43]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[44]  Ohad Ben-Shahar,et al.  Visual saliency and texture segregation without feature gradient , 2006, Proceedings of the National Academy of Sciences.

[45]  Jiro Gyoba,et al.  The visual phantom illusion: A perceptual product of surface completion depending on brightness and contrast. , 2006, Progress in brain research.

[46]  Semir Zeki,et al.  Masking reveals parallel form systems in the visual brain , 2014, Front. Hum. Neurosci..

[47]  Ken Nakayama,et al.  Brightness perception and filling-in , 1991, Vision Research.

[48]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[49]  Hamutal Slovin,et al.  Population Responses to Contour Integration: Early Encoding of Discrete Elements and Late Perceptual Grouping , 2013, Neuron.

[50]  W. Metzger.  Optische Untersuchungen am Ganzfeld , 1930 .

[51]  Victor A. F. Lamme,et al.  Confuse Your Illusion , 2013, Psychological science.

[52]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[53]  Wilson S. Geisler,et al.  Contour grouping: closure effects are explained by good continuation and proximity , 2004, Vision Research.

[54]  Heiko Neumann,et al.  Visual filling-in for computing perceptual surface properties , 2001, Biological Cybernetics.