Improving Color Constancy with Internet Photo Collections

Color constancy is the ability to measure colors of objects independent of the color of the light source. A well-known color constancy method makes use of the specular edge to estimate the illuminant. However, separating specular edge from input image is under-constrained and existing methods require user assistance or handle only simple scenes. This paper presents an iterative weighted Specular-Edge color constancy scheme that leverages large database of images gathered from the web. Given an input image, we execute an efficient visual search to find the closest visual context from the database and use the visual context as an image-specific prior. This prior is then used to correct the chromaticity of the input image before illumination estimation. Thus, introducing the prior can provide a good initial guess for the successive iteration. In the next, a specular-map guided filter is used to improve the precision of specular edge weighting. Consequently, it can increase the accuracy of estimating the illuminant. To the end, we evaluate our scheme on standard databases and the results show that the proposed scheme outperforms state of the art color constancy methods.

[1]  Katsushi Ikeuchi,et al.  Separating reflection components based on chromaticity and noise analysis , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[3]  Kobus Barnard,et al.  Estimating the scene illumination chromaticity by using a neural network. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Meng Wang,et al.  Visual query suggestion , 2009, ACM Multimedia.

[6]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Brian V. Funt,et al.  Estimating Illumination Chromaticity via Support Vector Regression , 2004, Color Imaging Conference.

[9]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[10]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[13]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Mehdi Rezagholizadeh,et al.  Edge-Based and Efficient Chromaticity Spatio-spectral Models for Color Constancy , 2013, 2013 International Conference on Computer and Robot Vision.

[15]  Brian V. Funt,et al.  A Large Image Database for Color Constancy Research , 2003, CIC.

[16]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[18]  Wojciech Matusik,et al.  Image restoration using online photo collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Joost van de Weijer,et al.  Edge and corner detection by photometric quasi-invariants , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  De Xu,et al.  Color constancy using 3D scene geometry , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[22]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .