Geometry in Nature

Form vision is traditionally regarded as processing primarily achromatic information. Previous investigations into the statistics of color and luminance in natural scenes have claimed that luminance and chromatic edges are not independent of each other and that any chromatic edge most likely occurs together with a luminance edge of similar strength. Here we computed the joint statistics of luminance and chromatic edges in over 700 calibrated color images from natural scenes. We found that isoluminant edges exist in natural scenes and were not rarer than pure luminance edges. Most edges combined luminance and chromatic information but to varying degrees such that luminance and chromatic edges were statistically independent of each other. Independence increased along successive stages of visual processing from cones via postreceptoral color-opponent channels to edges. The results show that chromatic edge contrast is an independent source of information that can be linearly combined with other cues for the proper segmentation of objects in natural and artificial vision systems. Color vision may have evolved in response to the natural scene statistics to gain access to this independent information.

[1]  Mongi A. Abidi,et al.  Fusion Of Edge Maps In Color Images , 1988, Other Conferences.

[2]  Arthur Bradley,et al.  Orientation and spatial frequency selectivity of adaptation to color and luminance gratings , 1988, Vision Research.

[3]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[4]  Bevil R. Conway,et al.  Spatial and Temporal Properties of Cone Signals in Alert Macaque Primary Visual Cortex , 2006, The Journal of Neuroscience.

[5]  Patrick Cavanagh,et al.  Mobile computation: spatiotemporal integration of the properties of objects in motion. , 2008, Journal of vision.

[6]  Ione Fine,et al.  Surface segmentation based on the luminance and color statistics of natural scenes. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  J D Mollon,et al.  Chromaticity as a signal of ripeness in fruits taken by primates. , 2000, The Journal of experimental biology.

[8]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Frederick A A Kingdom,et al.  Colour Vision Brings Clarity to Shadows , 2004, Perception.

[10]  Gunther Heidemann,et al.  The principal components of natural images revisited , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  T. W. Lee,et al.  Chromatic structure of natural scenes. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  J. H. Hateren.  Spatial, temporal and spectral pre-processing for colour vision , 1993 .

[13]  S. Grossberg.  Cortical dynamics of three-dimensional form, color, and brightness perception: I. Monocular theory , 1987, Perception & psychophysics.

[14]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[15]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes , 2001, Network.

[16]  Heiko Neumann,et al.  Visual filling-in for computing perceptual surface properties , 2001, Biological Cybernetics.

[17]  Kathy T. Mullen,et al.  Contour integration with colour and luminance contrast , 1996, Vision Research.

[18]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[19]  T Troscianko,et al.  Color and luminance information in natural scenes. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  J. V. van Hateren.  Spatial, temporal and spectral pre-processing for colour vision , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  D. Tolhurst,et al.  Spatiochromatic Properties of Natural Images and Human Vision , 2002, Current Biology.

[22]  D. Dacey.  Parallel pathways for spectral coding in primate retina. , 2000, Annual review of neuroscience.

[23]  Karl R. Gegenfurtner,et al.  Geometric-optical illusions at isoluminance , 2007, Vision Research.

[24]  G. Deco,et al.  An Information-Theoretic Approach to Neural Computing , 1997, Perspectives in Neural Computing.

[25]  R. Shapley,et al.  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001, Nature Neuroscience.

[26]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Sophie M. Wuerger,et al.  'Color Vision: From Genes to Perception' , 2000 .

[28]  K R Gegenfurtner,et al.  Processing of color, form, and motion in macaque area V2 , 1996, Visual Neuroscience.

[29]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[30]  A Bradley,et al.  Contrast dependence and mechanisms of masking interactions among chromatic and luminance gratings. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[31]  Paul G. Roofe,et al.  The Vertebrate Visual System , 1958, Neurology.

[32]  Karl R. Gegenfurtner,et al.  Color Vision: From Genes to Perception , 1999 .

[33]  K. Gegenfurtner,et al.  The contributions of color to recognition memory for natural scenes. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[34]  David Lee.  Coping with Discontinuities in Computer Vision: Their Detection, Classification, and Measurement , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Frederick A A Kingdom,et al.  Spatiochromatic statistics of natural scenes: first- and second-order information and their correlational structure. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[37]  R. Shapley,et al.  Cone inputs in macaque primary visual cortex. , 2004, Journal of Neurophysiology.

[38]  Colin W G Clifford,et al.  Interactions between color and luminance in the perception of orientation. , 2003, Journal of vision.

[39]  W. Geisler.  Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[40]  Bevil R. Conway,et al.  Color contrast in macaque V1. , 2002, Cerebral cortex.

[41]  T Troscianko,et al.  Spatio-Chromatic Information Content of Natural Scenes , 1996 .

[42]  K. Mullen,et al.  Color and luminance spatial tuning estimated by noise masking in the absence of off-frequency looking. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  K R Gegenfurtner,et al.  Chromatic and luminance edges in natural scenes , 2007 .

[44]  R. Shapley,et al.  The Orientation Selectivity of Color-Responsive Neurons in Macaque V1 , 2008, The Journal of Neuroscience.

[45]  J. Rieger,et al.  Sensory and cognitive contributions of color to the recognition of natural scenes , 2000, Current Biology.

[46]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[47]  Hong Zhou,et al.  The coding of uniform colour figures in monkey visual cortex , 2003, The Journal of physiology.

[48]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[49]  Bartlett W. Mel,et al.  Cue combination and color edge detection in natural scenes. , 2008, Journal of vision.

[50]  M. Webster,et al.  Adaptation and the color statistics of natural images , 1997, Vision Research.

[51]  K. Mullen.  The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[52]  A. Stockman,et al.  The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype , 2000, Vision Research.

[53]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[54]  Refractor.  Vision , 2000, The Lancet.

[55]  Kathy T Mullen,et al.  Comparison of color and luminance vision on a global shape discrimination task , 2002, Vision Research.

[56]  Eero P. Simoncelli.  Vision and the statistics of the visual environment , 2003, Current Opinion in Neurobiology.

[57]  Michael A. Webster,et al.  Selective tuning of face perception , 2004 .

[58]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[59]  A. Wallace.  The Colour Sense: its Origin and Development An Essay in Comparative Psychology , 1879, Nature.

[60]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .

[61]  K. D. De Valois,et al.  Orientation and spatial-frequency discrimination for luminance and chromatic gratings. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[62]  Gal Chechik,et al.  Group Redundancy Measures Reveal Redundancy Reduction in the Auditory Pathway , 2001, NIPS.

[63]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[64]  D. H. Kelly.  Spatiotemporal variation of chromatic and achromatic contrast thresholds. , 1983, Journal of the Optical Society of America.

[65]  Luc Tremblay,et al.  Online Control of Discrete Action following Visual Perturbation , 2007, Perception.

[66]  D. Brainard,et al.  Aberration-free measurements of the visibility of isoluminant gratings. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[67]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[68]  J D Mollon,et al.  Catarrhine photopigments are optimized for detecting targets against a foliage background. , 2000, The Journal of experimental biology.

[69]  B. Wandell,et al.  Pattern—color separable pathways predict sensitivity to simple colored patterns , 1996, Vision Research.

[70]  Kathy T Mullen,et al.  Contour integration in color vision: a common process for the blue–yellow, red–green and luminance mechanisms? , 2000, Vision Research.

[71]  R. Nevatia.  A Color Edge Detector and Its Use in Scene Segmentation , 1977 .

[72]  B. Wandell,et al.  Appearance of colored patterns: pattern-color separability. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[73]  Robert A. Frazor,et al.  Independence of luminance and contrast in natural scenes and in the early visual system , 2005, Nature Neuroscience.

[74]  Bevil R. Conway,et al.  Spatial Structure of Cone Inputs to Color Cells in Alert Macaque Primary Visual Cortex (V-1) , 2001, The Journal of Neuroscience.

[75]  Tobias E. Reisbeck,et al.  PII: S0042-6989(97)00240-X , 2003 .

[76]  D. G. Albrecht,et al.  Spatial mapping of monkey VI cells with pure color and luminance stimuli , 1984, Vision Research.

[77]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[78]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[79]  Joost van de Weijer,et al.  Robust photometric invariant features from the color tensor , 2006, IEEE Transactions on Image Processing.

[80]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[81]  Elena Gheorghiu,et al.  Chromatic tuning of contour-shape mechanisms revealed through the shape-frequency and shape-amplitude after-effects , 2007, Vision Research.

[82]  Geraint Rees,et al.  Combined orientation and colour information in human V1 for both L–M and S-cone chromatic axes , 2008, NeuroImage.

[83]  Frederick A A Kingdom,et al.  Color brings relief to human vision , 2003, Nature Neuroscience.

[84]  S. Grossberg.  The complementary brain: unifying brain dynamics and modularity , 2000, Trends in Cognitive Sciences.

[85]  W. Andrew.  The vertebrate visual system , 1957 .

[86]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[87]  E. Callaway,et al.  Parallel colour-opponent pathways to primary visual cortex , 2003, Nature.