Uniform color spaces and natural image statistics.

Many aspects of visual coding have been successfully predicted by starting from the statistics of natural scenes and then asking how the stimulus could be efficiently represented. We started from the representation of color characterized by uniform color spaces, and then asked what type of color environment they implied. These spaces are designed to represent equal perceptual differences in color discrimination or appearance by equal distances in the space. The relative sensitivity to different axes within the space might therefore reflect the gamut of colors in natural scenes. To examine this, we projected perceptually uniform distributions within the Munsell, CIE L(*)u(*)v(*) or CIE L(*)a(*)b(*) spaces into cone-opponent space. All were elongated along a bluish-yellowish axis reflecting covarying signals along the L-M and S-(L+M) cardinal axes, a pattern typical (though not identical) to many natural environments. In turn, color distributions from environments were more uniform when projected into the CIE L(*)a(*)b(*) perceptual space than when represented in a normalized cone-opponent space. These analyses suggest the bluish-yellowish bias in environmental colors might be an important factor shaping chromatic sensitivity, and also suggest that perceptually uniform color metrics could be derived from natural scene statistics and potentially tailored to specific environments.

[1]  W. Geisler Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[2]  R. M. Boynton,et al.  Similarity of Normalized Discrimination Ellipses in the Constant-Luminance Chromaticity Plane , 1986, Perception.

[3]  Steve Fotios,et al.  Measuring Colour , 2013 .

[4]  C. F. Stromeyer,et al.  Colour is what the eye sees best , 1993, Nature.

[5]  J. Mollon,et al.  Fruits, foliage and the evolution of primate colour vision. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  Joseph J Atick,et al.  Could information theory provide an ecological theory of sensory processing? , 2011, Network.

[7]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[8]  M. Webster Adaptation and visual coding. , 2011, Journal of vision.

[9]  J. Krauskopf,et al.  Color discrimination and adaptation , 1992, Vision Research.

[10]  H. Barlow Vision: A theory about the functional role and synaptic mechanism of visual after-effects , 1991 .

[11]  Michael A Webster,et al.  Variations in normal color vision. V. Simulations of adaptation to natural color environments , 2009, Visual Neuroscience.

[12]  Sergej N. Yendrikhovskij,et al.  Computing Color Categories from Statistics of Natural Images , 2001, Journal of Imaging Science and Technology.

[13]  Zhaoping Li,et al.  What does post-adaptation color appearance reveal about cortical color representation? , 1993, Vision Research.

[14]  R. Baddeley,et al.  The Relationship between Language and the Environment Information Theory Shows Why We Have Only Three Lightness Terms , 2022 .

[15]  J. Mollon,et al.  Reprinted from C. P. Gibson "Colour coded vs Monochrome Electronic Displays", Her Majesty's Stationery Office, London, 1984 REACTION TIME AS A MEASURE OF THE DISCRIMINABILITY OF LARGE COLOUR DIFFERENCES , 2007 .

[16]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[17]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[18]  M. Webster,et al.  Adaptation and visual salience. , 2010, Journal of vision.

[19]  David H Foster,et al.  Visual sensitivity to color errors in images of natural scenes , 2006, Visual Neuroscience.

[20]  Dale Purves,et al.  Natural scene statistics as the universal basis of color context effects , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[21]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[22]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[23]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[24]  Donald I. A. MacLeod,et al.  Color discrimination, color constancy and natural scene statistics , 2002 .

[25]  J D Mollon,et al.  Parafoveal color discrimination: a chromaticity locus of enhanced discrimination. , 2011, Journal of vision.

[26]  Anders Hård,et al.  NCS—Natural Color System: A Swedish Standard for Color Notation , 1981 .

[27]  T. Sejnowski,et al.  Cone selectivity derived from the responses of the retinal cone mosaic to natural scenes. , 2007, Journal of vision.

[28]  Colin W G Clifford,et al.  Combination of subcortical color channels in human visual cortex. , 2010, Journal of vision.

[29]  M. Vorobyev,et al.  Colour vision as an adaptation to frugivory in primates , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[30]  Yoko Mizokami,et al.  Seasonal variations in the color statistics of natural images , 2007, Network.

[31]  Michael A. Webster,et al.  Visual discomfort and natural image statistics , 2010 .

[32]  A. Robertson The CIE 1976 Color-Difference Formulae , 1977 .

[33]  Qasim Zaidi,et al.  Adaptive orthogonalization of opponent-color signals , 1993, Biological Cybernetics.

[34]  D. Brainard 5 – Color Appearance and Color Difference Specification , 2003 .

[35]  J. Mollon Monge: The Verriest Lecture, Lyon, July 2005 , 2006, Visual Neuroscience.

[36]  Vijay Balasubramanian,et al.  Natural Images from the Birthplace of the Human Eye , 2011, PloS one.

[37]  Dale Purves,et al.  The empirical basis of color perception , 2002, Consciousness and Cognition.

[38]  C. Howard,et al.  McCollough effect , 2011, Scholarpedia.

[39]  A Bradley,et al.  Contrast dependence and mechanisms of masking interactions among chromatic and luminance gratings. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[40]  Zhaoping Li,et al.  Understanding Retinal Color Coding from First Principles , 1992, Neural Computation.

[41]  M. Pointer A comparison of the CIE 1976 colour spaces , 2009 .

[42]  Roger N. Shepard,et al.  The perceptual organization of colors: An adaptation to regularities of the terrestrial world? , 1992 .

[43]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[44]  D. L. Macadam,et al.  Visual sensitivities to combined chromaticity and luminance differences. , 1949, Journal of the Optical Society of America.

[45]  W. McIlhagga,et al.  Detection mechanisms in L-, M-, and S-cone contrast space. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[46]  Roy S. Berns,et al.  Development of the 1929 munsell book of color: A historical review , 1985 .

[47]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[48]  A. Nagy,et al.  Critical color differences determined with a visual search task. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[49]  Q Zaidi,et al.  Identification of illuminant and object colors: heuristic-based algorithms. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[50]  M. Webster,et al.  Adaptation and perceptual norms in color vision. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[51]  J S Werner,et al.  Loci of achromatic points throughout the life span. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[52]  D. L. Macadam Visual Sensitivities to Color Differences in Daylight , 1942 .

[53]  Stanley T. Rolfe,et al.  A Comparison of the J -lntegral and CTOD Parameters for Short Crack Specimen Testing , 1991 .

[54]  T. W. Lee,et al.  Chromatic structure of natural scenes. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  D. Tolhurst,et al.  Spatiochromatic Properties of Natural Images and Human Vision , 2002, Current Biology.

[56]  D. W. Heeley,et al.  Cardinal directions of color space , 1982, Vision Research.

[57]  M. Webster,et al.  Adaptation and the color statistics of natural images , 1997, Vision Research.

[58]  M. Webster,et al.  Variations in normal color vision. II. Unique hues. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[59]  J. H. Hateren Spatial, temporal and spectral pre-processing for colour vision , 1993 .

[60]  M. Webster,et al.  The influence of contrast adaptation on color appearance , 1994, Vision Research.

[61]  Fuhui Long,et al.  Spectral statistics in natural scenes predict hue, saturation, and brightness. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Flávio P. Ferreira,et al.  Statistics of spatial cone-excitation ratios in natural scenes. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[63]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[64]  A. Wilkins,et al.  Uncomfortable Images in Art and Nature , 2008, Perception.

[65]  Robert M. Boynton,et al.  Chromatic difference steps of moderate size measured along theoretically critical axes , 1980 .

[66]  Charles A. Bouman,et al.  Optimized universal color palette design for error diffusion , 1995, J. Electronic Imaging.