Structural sparseness and spatial phase alignment in natural scenes.

The Fourier phase spectrum plays a central role regarding where in an image contours occur, thereby defining the spatial relationship between those structures in the overall scene. Only a handful of studies have demonstrated psychophysically the relevance of the Fourier phase spectrum with respect to human visual processing, and none have demonstrated the relative amount of local cross-scale spatial phase alignment needed to perceptually extract meaningful structure from an image. We investigated the relative amount of spatial phase alignment needed for humans to perceptually match natural scene image structures at three different spatial frequencies [3, 6, and 12 cycles per degree (cpd)] as a function of the number of structures within the image (i.e., "structural sparseness"). The results showed that (1) the amount of spatial phase alignment needed to match structures depends on structural sparseness, with a bias for matching structures at 6 cpd and (2) the ability to match partially phase-randomized images at a given spatial frequency is independent of structural sparseness at other spatial frequencies. The findings of the current study are discussed in terms of a network of feature integrators in the human visual system.

[1]  R F Hess,et al.  Spatial-frequency tuning of visual contour integration. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[3]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[4]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[5]  D. Pelli,et al.  Feature detection and letter identification , 2006, Vision Research.

[6]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[7]  D. Field,et al.  The roles of polarity and symmetry in the perceptual grouping of contour fragments. , 2000, Spatial vision.

[8]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[9]  G. Krieger,et al.  Higher-order statistics of natural images and their exploitation by operators selective to intrinsic dimensionality , 1997, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics.

[10]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[12]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[13]  Bruce C Hansen,et al.  The role of spatial phase in texture segmentation and contour integration. , 2006, Journal of vision.

[14]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[15]  R. Baddeley,et al.  Searching for filters with 'interesting' output distributions: an uninteresting direction to explore? , 1996, Network.

[16]  L N Piotrowski,et al.  A Demonstration of the Visual Importance and Flexibility of Spatial-Frequency Amplitude and Phase , 1982, Perception.

[17]  D. Braun,et al.  Phase noise and the classification of natural images , 2006, Vision Research.

[18]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[19]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[20]  Michael S. Lewicki,et al.  Relations between the statistical regularities of natural images and the response properties of the early visual system , 2005 .

[21]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[22]  Gerhard Krieger,et al.  Nonlinear image operators for the evaluation of local intrinsic dimensionality , 1996, IEEE Trans. Image Process..

[23]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[24]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[25]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[26]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[27]  D. Field,et al.  The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  C Chubb,et al.  Second-order processes in vision: introduction. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[30]  Bruce C. Hansen,et al.  Perceptual anisotropies in visual processing and their relation to natural image statistics , 2003, Network.

[31]  Wilson S. Geisler,et al.  Grouping local orientation and direction signals to extract spatial contours: Empirical tests of “association field” models of contour integration , 2005, Vision Research.

[32]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[33]  R F Hess,et al.  Contour integration and scale combination processes in visual edge detection. , 1999, Spatial vision.

[34]  Edward A Essock,et al.  A horizontal bias in human visual processing of orientation and its correspondence to the structural components of natural scenes. , 2004, Journal of vision.

[35]  Zhou Wang,et al.  Local Phase Coherence and the Perception of Blur , 2003, NIPS.

[36]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[37]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[38]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[39]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[40]  Edward A. Essock,et al.  Influence of scale and orientation on the visual perception of natural scenes , 2005 .

[41]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[42]  J. Robson,et al.  Probability summation and regional variation in contrast sensitivity across the visual field , 1981, Vision Research.

[43]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[44]  J.G. Daugman,et al.  Entropy reduction and decorrelation in visual coding by oriented neural receptive fields , 1989, IEEE Transactions on Biomedical Engineering.

[45]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[46]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[47]  Feng Qi Han,et al.  Cortical Sensitivity to Visual Features in Natural Scenes , 2005, PLoS biology.

[48]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[49]  D. Pollen,et al.  Relationship between spatial frequency selectivity and receptive field profile of simple cells. , 1979, The Journal of physiology.