Spatiochromatic statistics of natural scenes: first- and second-order information and their correlational structure.

Spatial filters that mimic receptive fields of visual cortex neurons provide an efficient representation of achromatic image structure, but the extension of this idea to chromatic information is at an early stage. Relatively few studies have looked at the statistical relationships between the modeled responses to natural scenes of the luminance (LUM), red-green (RG), and blue-yellow (BY) postreceptoral channels of the primate visual system. Here we consider the correlations among these channel responses in terms of pixel, first-order, and second-order information. First-order linear filtering was implemented by convolving the cosine-windowed images with oriented Gabor functions, whose gains were scaled to give equal amplitude response across spatial frequency to random fractal images. Second-order filtering was implemented via a filter-rectify-filter cascade, with Gabor functions for both first- and second-stage filters. Both signed and unsigned filter responses were obtained across a range of filter parameters (spatial frequency, 2-64 cycles/image; orientation, 0-135 degrees). The filter responses to the LUM channel images were larger than those for either RG or BY channel images. Cross correlations between the first-order channel responses and between the first- and second-order channel responses were measured. Results showed that the unsigned correlations between first-order channel responses were higher than expected on the basis of previous studies and that first-order channel responses were highly correlated with LUM, but not with RG or BY, second-order responses. These findings imply that course-scale color information correlates well with course-scale changes of fine-scale texture.

[1]  M. Georgeson,et al.  Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour , 1999, Vision Research.

[2]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[3]  K. Mullen,et al.  Evidence for the stochastic independence of the blue-yellow, red-green and luminance detection mechanisms revealed by subthreshold summation , 1999, Vision Research.

[4]  Michael S. Landy,et al.  Orthogonal Distribution Analysis: A New Approach to the Study of Texture Perception , 1991 .

[5]  Mitchell G. A. Thomson,et al.  Higher-order structure in natural scenes , 1999 .

[6]  J. M. Rubin,et al.  Color vision and image intensities: When are changes material? , 1982, Biological Cybernetics.

[7]  Ione Fine,et al.  Surface segmentation based on the luminance and color statistics of natural scenes , 2002 .

[8]  Arthur Bradley,et al.  Orientation and spatial frequency selectivity of adaptation to color and luminance gratings , 1988, Vision Research.

[9]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[11]  Frederick A A Kingdom,et al.  Color brings relief to human vision , 2003, Nature Neuroscience.

[12]  M. Webster,et al.  Adaptation and the color statistics of natural images , 1997, Vision Research.

[13]  Frederick A.A. Kingdom,et al.  Chromatic properties of the colour-shading effect , 2005, Vision Research.

[14]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[15]  K R Gegenfurtner,et al.  Contrast detection in luminance and chromatic noise. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[16]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[17]  D. Brainard,et al.  Aberration-free measurements of the visibility of isoluminant gratings. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[19]  J. Koenderink,et al.  Spatial and temporal discrimination ellipsoids in color space. , 1983, Journal of the Optical Society of America.

[20]  T Troscianko,et al.  Color and luminance information in natural scenes. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  C. Baker Central neural mechanisms for detecting second-order motion , 1999, Current Opinion in Neurobiology.

[22]  N. Graham,et al.  A note about preferred orientations at the first and second stages of complex (second-order) texture channels. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  D. Knill Contour into texture: information content of surface contours and texture flow. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Andrew T. Smith,et al.  Evidence for separate motion-detecting mechanisms for first- and second-order motion in human vision , 1994, Vision Research.

[25]  Donald I. A. MacLeod,et al.  Influence of scene statistics on colour constancy , 2002, Nature.

[26]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[27]  Kemt A. Stevens,et al.  The Line of Curvature Constraint and the Interpretation of 3-D Shape From Parallel Surface Contours , 1983, IJCAI.

[28]  C. Baker,et al.  First- and second-order information in natural images: a filter-based approach to image statistics. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  B. Wandell,et al.  Appearance of colored patterns: pattern-color separability. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  A J Schofield,et al.  What Does Second-Order Vision See in an Image? , 2000, Perception.

[31]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[32]  Curtis L. Baker,et al.  Sparse Coding in First- and Second-Order Filtered Images. , 2004 .

[33]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[34]  D. Tolhurst,et al.  Spatiochromatic Properties of Natural Images and Human Vision , 2002, Current Biology.

[35]  Orientation- and frequency-modulated textures at low depths of modulation are processed by off-orientation and off-frequency texture mechanisms , 2002, Vision Research.

[36]  D. W. Heeley,et al.  Cardinal directions of color space , 1982, Vision Research.

[37]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[39]  T. Albright,et al.  Neuronal responses to edges defined by luminance vs. temporal texture in macaque area V1 , 1997, Visual Neuroscience.

[40]  C. F. Stromeyer,et al.  Second-site adaptation in the red-green chromatic pathways , 1985, Vision Research.

[41]  Pascal Mamassian,et al.  Interaction of visual prior constraints , 2001, Vision Research.

[42]  M. Thomson,et al.  Visual coding and the phase structure of natural scenes. , 1999, Network.

[43]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[44]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[45]  N. Graham,et al.  Spatial summation in simple (fourier) and complex (non-fourier) texture channels , 1998, Vision Research.

[46]  Hugh R. Wilson,et al.  Spatial-frequency adaptation: Evidence for a multiple-channel model of short-wavelength-sensitive-cone spatial vision , 1993, Vision Research.

[47]  M. Thomson Beats, kurtosis and visual coding , 2001, Network.

[48]  ANDREW T SMITH,et al.  Separate Detection of Moving Luminance and Contrast Modulations: Fact or Artifact? , 1997, Vision Research.

[49]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[50]  K. Mullen The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[51]  Frederick A A Kingdom,et al.  Colour Vision Brings Clarity to Shadows , 2004, Perception.

[52]  G. Sperling,et al.  Measuring the spatial frequency selectivity of second-order texture mechanisms , 1995, Vision Research.

[53]  Olof Bryngdahl,et al.  Phase gratings with subwavelength structures , 1995 .

[54]  K. Mullen,et al.  Postreceptoral chromatic detection mechanisms revealed by noise masking in three-dimensional cone contrast space. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  C. Baker,et al.  Temporal and spatial response to second-order stimuli in cat area 18. , 1998, Journal of neurophysiology.

[56]  N. Graham,et al.  Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation , 1993, Vision Research.

[57]  R. Shapley,et al.  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001, Nature Neuroscience.

[58]  C L Baker,et al.  Spatial properties of envelope-responsive cells in area 17 and 18 neurons of the cat. , 1996, Journal of neurophysiology.

[59]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[60]  T D Albright,et al.  Form-cue invariant motion processing in primate visual cortex. , 1992, Science.

[61]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[62]  W. McIlhagga,et al.  Detection mechanisms in L-, M-, and S-cone contrast space. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[63]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.