Color Constancy Using Double-Opponency

The double-opponent (DO) color-sensitive cells in the primary visual cortex (V1) of the human visual system (HVS) have long been recognized as the physiological basis of color constancy. In this work we propose a new color constancy model by imitating the functional properties of the HVS from the single-opponent (SO) cells in the retina to the DO cells in V1 and the possible neurons in the higher visual cortexes. The idea behind the proposed double-opponency based color constancy (DOCC) model originates from the substantial observation that the color distribution of the responses of DO cells to the color-biased images coincides well with the vector denoting the light source color. Then the illuminant color is easily estimated by pooling the responses of DO cells in separate channels in LMS space with the pooling mechanism of sum or max. Extensive evaluations on three commonly used datasets, including the test with the dataset dependent optimal parameters, as well as the intraand inter-dataset cross validation, show that our physiologically inspired DOCC model can produce quite competitive results in comparison to the state-of-the-art approaches, but with a relative simple implementation and without requiring fine-tuning of the method for each different dataset.

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  Chin-Teng Lin,et al.  Bio-Inspired Computer Fovea Model Based on Hexagonal-Type Cellular Neural Network , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  Tom Minka,et al.  Bayesian Color Constancy with Non-Gaussian Models , 2003, NIPS.

[4]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[5]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[6]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[7]  Esa Rahtu,et al.  Applying Visual Object Categorization and Memory Colors for Automatic Color Constancy , 2009, ICIAP.

[8]  Brian V. Funt,et al.  Estimating Illumination Chromaticity via Support Vector Regression , 2004, Color Imaging Conference.

[9]  María Vanrell,et al.  Color Constancy by Category Correlation , 2012, IEEE Transactions on Image Processing.

[10]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Gerald Schaefer,et al.  A combined physical and statistical approach to colour constancy , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Gerald Schaefer,et al.  Solving for Colour Constancy using a Constrained Dichromatic Reflection Model , 2001, International Journal of Computer Vision.

[13]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  R. Shapley,et al.  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001, Nature Neuroscience.

[15]  Raimondo Schettini,et al.  Improving Color Constancy Using Indoor–Outdoor Image Classification , 2008, IEEE Transactions on Image Processing.

[16]  Alessandro Rizzi,et al.  Mathematical definition and analysis of the retinex algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.

[18]  Theo Gevers,et al.  Color Constancy for Multiple Light Sources , 2012, IEEE Transactions on Image Processing.

[19]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[20]  Bevil R. Conway,et al.  Neural basis for unique hues , 2008, Current Biology.

[21]  Graham D. Finlayson,et al.  Corrected-Moment Illuminant Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  John J. McCann,et al.  Retinex in Matlab , 2000, CIC.

[23]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[24]  Raimondo Schettini,et al.  Adaptive Color Constancy Using Faces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[26]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Keigo Hirakawa,et al.  Color Constancy with Spatio-Spectral Statistics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[30]  Mark S. Drew,et al.  Exemplar-Based Colour Constancy , 2012, BMVC.

[31]  Yongjie Li,et al.  Efficient Color Boundary Detection with Color-Opponent Mechanisms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Rodney M. Goodman,et al.  A real-time neural system for color constancy , 1991, IEEE Trans. Neural Networks.

[34]  Brian V. Funt,et al.  Committee-Based Color Constancy , 1999, CIC.

[35]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[36]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[38]  Brian V. Funt,et al.  A data set for color research , 2002 .

[39]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[42]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[43]  Yongjie Li,et al.  A Color Constancy Model with Double-Opponency Mechanisms , 2013, 2013 IEEE International Conference on Computer Vision.

[44]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  S. D. Hordley,et al.  Reevaluation of color constancy algorithm performance. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[47]  Steven D. Hordley,et al.  Scene illuminant estimation: Past, present, and future , 2006 .

[48]  Joost van de Weijer,et al.  Generalized Gamut Mapping using Image Derivative Structures for Color Constancy , 2008, International Journal of Computer Vision.

[49]  Hedva Spitzer,et al.  Color constancy: a biological model and its application for still and video images , 2000, 21st IEEE Convention of the Electrical and Electronic Engineers in Israel. Proceedings (Cat. No.00EX377).

[50]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[51]  Bevil R. Conway,et al.  Toward a Unified Theory of Visual Area V4 , 2012, Neuron.

[52]  Donald I. A. MacLeod,et al.  Influence of scene statistics on colour constancy , 2002, Nature.

[53]  S. Zeki Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours , 1983, Neuroscience.

[54]  Kobus Barnard,et al.  Estimating the scene illumination chromaticity by using a neural network. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  Cordelia Schmid,et al.  Using High-Level Visual Information for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[56]  Mark S. Drew,et al.  Specularity, the Zeta-image, and Information-Theoretic Illuminant Estimation , 2012, ECCV Workshops.

[57]  Hoi Ying Lau Neural inspired color constancy model based on double opponent neurons , 2008 .

[58]  Raimondo Schettini,et al.  Automatic color constancy algorithm selection and combination , 2010, Pattern Recognit..

[59]  Bevil R. Conway,et al.  Color Vision, Cones, and Color-Coding in the Cortex , 2009, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[60]  P. Lennie,et al.  The machinery of colour vision , 2007, Nature Reviews Neuroscience.

[61]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[62]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[63]  Bevil R. Conway,et al.  Advances in Color Science: From Retina to Behavior , 2010, The Journal of Neuroscience.

[64]  Leif H. Finkel,et al.  A multistage neural network for color constancy and color induction , 1995, IEEE Trans. Neural Networks.

[65]  Marc Ebner,et al.  Evolving color constancy , 2006, Pattern Recognit. Lett..

[66]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[67]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[68]  D. Kiper,et al.  Chromatic properties of neurons in macaque area V2 , 1997, Visual Neuroscience.

[69]  Bevil R. Conway,et al.  Specialized Color Modules in Macaque Extrastriate Cortex , 2007, Neuron.

[70]  Lilong Shi,et al.  The Rehabilitation of MaxRGB , 2010, CIC.

[71]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[72]  K. Gegenfurtner,et al.  Memory modulates color appearance , 2006, Nature Neuroscience.

[73]  P. A. Dufort,et al.  Color categorization and color constancy in a neural network model of V4 , 1991, Biological Cybernetics.

[74]  D. J. Felleman,et al.  A spatially organized representation of colour in macaque cortical area V2 , 2003, Nature.