Segmenting surface boundaries using luminance cues: Underlying mechanisms

Segmenting scenes into distinct surfaces is a basic visual perception task, and luminance differences between adjacent surfaces often provide an important segmentation cue. However, mean luminance differences between two surfaces may exist without any sharp change in albedo at their boundary, but rather from differences in the proportion of small light and dark areas within each surface, e.g. texture elements, which we refer to as a luminance texture boundary. Here we investigate the performance of human observers segmenting luminance texture boundaries. We demonstrate that a simple model involving a single stage of filtering cannot explain observer performance, unless it incorporates contrast normalization. Performing additional experiments in which observers segment luminance texture boundaries while ignoring super-imposed luminance step boundaries, we demonstrate that the one-stage model, even with contrast normalization, cannot explain performance. We then present a Filter-Rectify-Filter (FRF) model positing two cascaded stages of filtering, which fits our data well, and explains observers’ ability to segment luminance texture boundary stimuli in the presence of interfering luminance step boundaries. We propose that such computations may be useful for boundary segmentation in natural scenes, where shadows often give rise to luminance step edges which do not correspond to surface boundaries.

[1]  Nikolaus Kriegeskorte,et al.  Deep neural networks: a new framework for modelling biological vision and brain information processing , 2015, bioRxiv.

[2]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[3]  Frederick A A Kingdom,et al.  Spatiochromatic statistics of natural scenes: first- and second-order information and their correlational structure. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Mary M. Conte,et al.  Textures as Probes of Visual Processing. , 2017, Annual review of vision science.

[5]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[6]  Shih-Wei Wu,et al.  Limits to human movement planning in tasks with asymmetric gain landscapes. , 2006, Journal of vision.

[7]  R. Allard,et al.  Double dissociation between first- and second-order processing , 2007, Vision Research.

[8]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  Miguel Castelo-Branco,et al.  The linear impact of concurrent working memory load on dynamics of Necker cube perceptual reversals. , 2014, Journal of vision.

[11]  Michael S. Landy,et al.  Orthogonal Distribution Analysis: A New Approach to the Study of Texture Perception , 1991 .

[12]  M. Georgeson,et al.  Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour , 1999, Vision Research.

[13]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[14]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[15]  Hermann Wagner,et al.  Disparity sensitivity in man and owl: Psychophysical evidence for equivalent perception of shape-from-stereo. , 2011, Journal of vision.

[16]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[17]  Isabelle Mareschal,et al.  A cortical locus for the processing of contrast-defined contours , 1998, Nature Neuroscience.

[18]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[19]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[20]  Josée Rivest,et al.  Localizing contours defined by more than one attribute , 1996, Vision Research.

[21]  Curtis L Baker,et al.  Natural versus Synthetic Stimuli for Estimating Receptive Field Models: A Comparison of Predictive Robustness , 2012, The Journal of Neuroscience.

[22]  William McIlhagga,et al.  Estimates of edge detection filters in human vision , 2018, Vision Research.

[23]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[24]  William McIlhagga,et al.  Evidence for chromatic edge detectors in human vision using classification images. , 2018, Journal of vision.

[25]  Celeste McCollough Howard Phantom fringes 1951–2003: Exciting the imaginations of psychologists, physiologists, and model builders , 2010 .

[26]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[27]  Mathias Abegg,et al.  Timing of concurrent visual stimuli determines modulation of saccadic amplitude. , 2018, Journal of vision.

[28]  Li Fei-Fei,et al.  Visual categorization is automatic and obligatory: evidence from Stroop-like paradigm. , 2014, Journal of vision.

[29]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[30]  Marcel A. J. van Gerven,et al.  Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream , 2014, The Journal of Neuroscience.

[31]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Curtis L. Baker,et al.  Texture sparseness, but not local phase structure, impairs second-order segmentation , 2013, Vision Research.

[33]  Keith Rayner,et al.  The mask-onset delay paradigm and the availability of central and peripheral visual information during scene viewing. , 2012, Journal of vision.

[34]  Jack M. Loomis Using immersive virtual reality to study visual space perception, visual control of locomotion, and visually-based navigation , 2002 .

[35]  Gouki Okazawa,et al.  Gradual Development of Visual Texture-Selective Properties Between Macaque Areas V2 and V4 , 2016, Cerebral cortex.

[36]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[37]  Isamu Motoyoshi,et al.  Differential roles of contrast polarity reveal two streams of second-order visual processing , 2007, Vision Research.

[38]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[39]  M. Landy,et al.  Combination of texture and color cues in visual segmentation , 2012, Vision Research.

[40]  M. Fabre-Thorpe,et al.  A need for more information uptake but not focused attention to access basic-level representations. , 2012, Journal of vision.

[41]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[42]  Christopher DiMattina,et al.  Modeling second-order boundary perception: A machine learning approach , 2018, bioRxiv.

[43]  M. Landy,et al.  Discrimination of orientation-defined texture edges , 1995, Vision Research.

[44]  Thomas Serre,et al.  A systematic comparison between visual cues for boundary detection , 2016, Vision Research.

[45]  Nathalie Guyader,et al.  Color improves edge classification in human vision , 2019, PLoS Comput. Biol..

[46]  S. Dakin,et al.  Sensitivity to contrast modulation depends on carrier spatial frequency and orientation , 2000, Vision Research.

[47]  James H. Elder,et al.  Psychophysical receptive fields of edge detection mechanisms , 2004, Vision Research.

[48]  J. Victor,et al.  Responses to Orientation Discontinuities in V1 and V2: Physiological Dissociations and Functional Implications , 2014, The Journal of Neuroscience.