Effects of element separation and carrier wavelength on detection of snakes and ladders: implications for models of contour integration.

In this paper, we examine the mechanisms underlying the perceptual integration of two types of contour: snakes (composed of Gabor elements parallel to the path of the contour) and ladders (with elements perpendicular to the path). We varied the element separation and carrier wavelength. Increasing the element separation impaired detection of snakes but did not affect ladders; at high separations, snakes and ladders were closely matched in difficulty. One subject showed no effect of carrier wavelength, and the other showed a decline in performance as the wavelength increased. We discuss how these results might be accommodated by association field models. We also present a new model in which the linkage results from overlap in the filter responses to adjacent elements. We show that, if 1st-order filters are used, the model's performance on widely spaced snake contours deteriorates greatly as the carrier wavelength of the elements decreases, in contrast to our psychophysical results. To integrate widely spaced contours with short carrier wavelengths, the model requires a 2nd-order process, in which a nonlinearity intervenes between small-scale 1st-stage filters and large-scale 2nd-stage filters. This model detects snakes when the 1st and 2nd stage filters have the same orientation, and detects ladders when they are orthogonal.

[1]  M. Cynader,et al.  Surface organization of orientation and direction selectivity in cat area 18 , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  James M. Bower,et al.  Computational Neuroscience: Trends in Research 1995 , 1996 .

[3]  A. Grinvald,et al.  Relationships between orientation-preference pinwheels, cytochrome oxidase blobs, and ocular-dominance columns in primate striate cortex. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Bruce C Hansen,et al.  The role of spatial phase in texture segmentation and contour integration. , 2006, Journal of vision.

[5]  R F Hess,et al.  Spatial-frequency tuning of visual contour integration. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Branka Spehar,et al.  Dynamics of cross- and iso-surround facilitation suggest distinct mechanisms , 2005, Vision Research.

[7]  H R Wilson.  Nonlinear processes in visual pattern discrimination. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[8]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[9]  A. Grinvald,et al.  The layout of iso-orientation domains in area 18 of cat visual cortex: optical imaging reveals a pinwheel-like organization , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  D. Hubel,et al.  Sequence regularity and geometry of orientation columns in the monkey striate cortex , 1974, The Journal of comparative neurology.

[12]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[13]  M. Georgeson,et al.  Added luminance ramp alters perceived edge blur and contrast: A critical test for derivative-based models of edge coding , 2007, Vision Research.

[14]  Zhaoping Li,et al.  Psychophysical Tests of the Hypothesis of a Bottom-Up Saliency Map in Primary Visual Cortex , 2007, PLoS Comput. Biol..

[15]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[16]  Robert F Hess,et al.  Contour integration in the peripheral field , 1999, Vision Research.

[17]  Martin Wattenberg,et al.  Filtering in feature space: a computational model of grouping by proximity and similarity , 2010 .

[18]  N. Graham,et al.  Spatial summation in simple (fourier) and complex (non-fourier) texture channels , 1998, Vision Research.

[19]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[20]  Steven C. Dakin,et al.  Absence of contour linking in peripheral vision , 1997, Nature.

[21]  Keith A May,et al.  From filters to features: scale-space analysis of edge and blur coding in human vision. , 2007, Journal of vision.

[22]  R F Hess,et al.  Relationship between facilitation at threshold and suprathreshold contour integration. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  Branka Spehar,et al.  Dynamics of collinear contrast facilitation are consistent with long-range horizontal striate transmission , 2005, Vision Research.

[24]  Wilson S. Geisler,et al.  Grouping local orientation and direction signals to extract spatial contours: Empirical tests of “association field” models of contour integration , 2005, Vision Research.

[25]  Pg Lovell.  Manipulating contour smoothness: Evidence that the association-field model underlies contour integration in the periphery , 2005 .

[26]  K. Mullen,et al.  How long range is contour integration in human color vision? , 2003, Visual Neuroscience.

[27]  Amiram Grinvald,et al.  Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns , 1991, Nature.

[28]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[29]  M J Morgan,et al.  The Combination of Filters in Early Spatial Vision: A Retrospective Analysis of the Mirage Model , 1997, Perception.

[30]  H. Wilson,et al.  Fourier and Non-Fourier Pattern Discrimination Compared , 1996, Vision Research.

[31]  Steven C. Dakin,et al.  The detection of structure in glass patterns: Psychophysics and computational models , 1997, Vision Research.

[32]  M. Georgeson,et al.  Blurred edges look faint, and faint edges look sharp: The effect of a gradient threshold in a multi-scale edge coding model , 2007, Vision Research.

[33]  N. Graham,et al.  Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation , 1993, Vision Research.

[34]  Norma Graham,et al.  Nonlinear processes in spatial-frequency channel models of perceived texture segregation: Effects of sign and amount of contrast , 1992, Vision Research.

[35]  S. Dakin,et al.  Snakes and ladders: the role of temporal modulation in visual contour integration , 2001, Vision Research.

[36]  R. Hess,et al.  Ladder contours are undetectable in the periphery: a crowding effect? , 2007, Journal of vision.

[37]  T. Wiesel,et al.  Functional architecture of cortex revealed by optical imaging of intrinsic signals , 1986, Nature.

[38]  D. Pelli,et al.  Crowding is unlike ordinary masking: distinguishing feature integration from detection. , 2004, Journal of vision.

[39]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[40]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[41]  Michael S. Landy,et al.  Complex Channels, Early Local Nonlinearities, and Normalization in Texture Segregation , 1991 .

[42]  Steven C. Dakin,et al.  Flank facilitation and contour integration: Different sites , 2006, Vision Research.

[43]  G. Blasdel,et al.  Orientation selectivity, preference, and continuity in monkey striate cortex , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  G. Blasdel,et al.  Voltage-sensitive dyes reveal a modular organization in monkey striate cortex , 1986, Nature.

[45]  Leif H. Finkel,et al.  Cortical synchronization mechanism for “pop-out” of salient image contours , 1997 .

[46]  Robert F Hess,et al.  Dynamics of snakes and ladders. , 2007, Journal of vision.

[47]  Leif H. Finkel,et al.  Salient Contour Extraction by Temporal Binding in a Cortically-based Network , 1996, NIPS.

[48]  J. Beck,et al.  Contrast and spatial variables in texture segregation: Testing a simple spatial-frequency channels model , 1989, Perception & psychophysics.

[49]  R F Hess,et al.  Contour integration and scale combination processes in visual edge detection. , 1999, Spatial vision.

[50]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[51]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[52]  Robert F Hess,et al.  Impoverished second-order input to global linking in human vision , 2000, Vision Research.