First- and second-order information in natural images: a filter-based approach to image statistics.

Previous analyses of natural image statistics have dealt mainly with their Fourier power spectra. Here we explore image statistics by examining responses to biologically motivated filters that are spatially localized and respond to first-order (luminance-defined) and second-order (contrast- or texture-defined) characteristics. We compare the distribution of natural image responses across filter parameters for first- and second-order information. We find that second-order information in natural scenes shows the same self-similarity previously described for first-order information but has substantially less orientational anisotropy. The magnitudes of the two kinds of information, as well as their mutual unsigned correlation, are much stronger for particular combinations of filter parameters in natural images but not in unstructured fractal images having the same power spectra.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[3]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[4]  G. F. Cooper,et al.  The spatial selectivity of the visual cells of the cat , 1969, The Journal of physiology.

[5]  L. Palmer,et al.  Receptive-field structure in cat striate cortex. , 1981, Journal of neurophysiology.

[6]  D. Tolhurst,et al.  On the variety of spatial frequency selectivities shown by neurons in area 17 of the cat , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[8]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[10]  D. Field,et al.  The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[12]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[13]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[14]  P. Cavanagh,et al.  Motion: the long and short of it. , 1989, Spatial vision.

[15]  D. G. Albrecht,et al.  Visual cortical receptive fields in monkey and cat: Spatial and temporal phase transfer function , 1989, Vision Research.

[16]  D. Field,et al.  Human discrimination of fractal images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[17]  R. Baddeley,et al.  A statistical analysis of natural images matches psychophysically derived orientation tuning curves , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[19]  R. Marc,et al.  Glutamate antagonists that block hyperpolarizing bipolar cells increase the release of dopamine from turtle retina , 1992, Visual Neuroscience.

[20]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[21]  T D Albright,et al.  Form-cue invariant motion processing in primate visual cortex. , 1992, Science.

[22]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[23]  N. Graham,et al.  Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation , 1993, Vision Research.

[24]  D. Tolhurst,et al.  Discrimination of changes in the second-order statistics of natural and synthetic images , 1994, Vision Research.

[25]  D. Ruderman.  The statistics of natural images , 1994 .

[26]  Andrew T. Smith,et al.  Evidence for separate motion-detecting mechanisms for first- and second-order motion in human vision , 1994, Vision Research.

[27]  A. T. Smith,et al.  Direction identification thresholds for second-order motion in central and peripheral vision. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  G. Sperling,et al.  Full-wave and half-wave rectification in second-order motion perception , 1994, Vision Research.

[29]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[30]  G. Sperling,et al.  The functional architecture of human visual motion perception , 1995, Vision Research.

[31]  G. Sperling,et al.  Measuring the spatial frequency selectivity of second-order texture mechanisms , 1995, Vision Research.

[32]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[33]  C L Baker,et al.  Spatial properties of envelope-responsive cells in area 17 and 18 neurons of the cat. , 1996, Journal of neurophysiology.

[34]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[35]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[36]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[37]  T. Albright,et al.  Neuronal responses to edges defined by luminance vs. temporal texture in macaque area V1 , 1997, Visual Neuroscience.

[38]  Dario L. Ringach,et al.  Dynamics of orientation tuning in macaque primary visual cortex , 1997, Nature.

[39]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[40]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[41]  ANDREW T SMITH,et al.  Separate Detection of Moving Luminance and Contrast Modulations: Fact or Artifact? , 1997, Vision Research.

[42]  Isabelle Mareschal,et al.  A cortical locus for the processing of contrast-defined contours , 1998, Nature Neuroscience.

[43]  A. Leventhal,et al.  Neural correlates of boundary perception , 1998, Visual Neuroscience.

[44]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[45]  N. Graham,et al.  Spatial summation in simple (fourier) and complex (non-fourier) texture channels , 1998, Vision Research.

[46]  C. Baker,et al.  Temporal and spatial response to second-order stimuli in cat area 18. , 1998, Journal of neurophysiology.

[47]  C. Baker.  Central neural mechanisms for detecting second-order motion , 1999, Current Opinion in Neurobiology.

[48]  Stephane J. M. Rainville,et al.  Spatial-scale contribution to the detection of mirror symmetry in fractal noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[49]  F. Kingdom,et al.  On the mechanism for scale invariance in orientation-defined textures , 1999, Vision Research.

[50]  A. Derrington,et al.  Second-order motion discrimination by feature-tracking , 1999, Vision Research.

[51]  M. Georgeson,et al.  Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour , 1999, Vision Research.

[52]  A. Cowey,et al.  Perception of first‐ and second‐order motion: Separable neurological mechanisms? , 1999, Human brain mapping.

[53]  I Mareschal,et al.  Cortical processing of second-order motion , 1999, Visual Neuroscience.

[54]  N. Graham,et al.  Normalization: contrast-gain control in simple (Fourier) and complex (non-Fourier) pathways of pattern vision , 2000, Vision Research.

[55]  S. Dakin,et al.  Sensitivity to contrast modulation depends on carrier spatial frequency and orientation , 2000, Vision Research.

[56]  A J Schofield,et al.  What Does Second-Order Vision See in an Image? , 2000, Perception.

[57]  C. Furmanski,et al.  An oblique effect in human primary visual cortex , 2000, Nature Neuroscience.

[58]  M. Thomson.  Beats, kurtosis and visual coding , 2001, Network.

[59]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[60]  N. Graham,et al.  A note about preferred orientations at the first and second stages of complex (second-order) texture channels. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[61]  Aapo Hyvärinen,et al.  A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images , 2001, Vision Research.

[62]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[63]  D. Ringach.  Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. , 2002, Journal of neurophysiology.

[64]  Frederick A A Kingdom,et al.  Detection and discrimination of texture modulations defined by orientation, spatial frequency, and contrast. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[65]  Alan C. Evans,et al.  Cortical specialization for processing first- and second-order motion. , 2003, Cerebral cortex.

[66]  R. Freeman,et al.  Oblique effect: a neural basis in the visual cortex. , 2003, Journal of neurophysiology.

[67]  Edward A. Essock,et al.  Oblique stimuli are seen best (not worst!) in naturalistic broad-band stimuli: a horizontal effect , 2003, Vision Research.