Constrained low-rank gamut completion for robust illumination estimation

Abstract. Illumination estimation is an important component of color constancy and automatic white balancing. According to recent survey and evaluation work, the supervised methods with a learning phase are competitive for illumination estimation. However, the robustness and performance of any supervised algorithm suffer from an incomplete gamut in training image sets because of limited reflectance surfaces in a scene. In order to address this problem, we present a constrained low-rank gamut completion algorithm, which can replenish gamut from limited surfaces in an image, for robust illumination estimation. In the proposed algorithm, we first discuss why the gamut completion is actually a low-rank matrix completion problem. Then a constrained low-rank matrix completion framework is proposed by adding illumination similarities among the training images as an additional constraint. An optimization algorithm is also given out by extending the augmented Lagrange multipliers. Finally, the completed gamut based on the proposed algorithm is fed into the support vector regression (SVR)-based illumination estimation method to evaluate the effect of gamut completion. The experimental results on both synthetic and real-world image sets show that the proposed gamut completion model not only can effectively improve the performance of the original SVR method but is also robust to the surface insufficiency in training samples.

[1]  Paul F. Whelan,et al.  Image segmentation based on the integration of colour-texture descriptors - A review , 2011, Pattern Recognit..

[2]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[3]  De Xu,et al.  Colour constancy based on texture similarity for natural images , 2009 .

[4]  De Xu,et al.  Color constancy using 3D scene geometry , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Graham D. Finlayson,et al.  Corrected-Moment Illuminant Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Bing Li,et al.  Evaluating Combinational Illumination Estimation Methods on Real-World Images , 2014, IEEE Transactions on Image Processing.

[7]  G D Finlayson,et al.  Color constancy at a pixel. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Brian V. Funt,et al.  Estimating Illumination Chromaticity via Support Vector Regression , 2004, Color Imaging Conference.

[9]  Yongtian Wang,et al.  Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery , 2010, ACCV.

[10]  De Xu,et al.  Color Constancy Using Achromatic Surface , 2010 .

[11]  Yongjie Li,et al.  A Color Constancy Model with Double-Opponency Mechanisms , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[13]  Kobus Barnard,et al.  Estimating the scene illumination chromaticity by using a neural network. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  Cordelia Schmid,et al.  Using High-Level Visual Information for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[16]  Bing Li,et al.  Multi-Cue Illumination Estimation via a Tree-Structured Group Joint Sparse Representation , 2015, International Journal of Computer Vision.

[17]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[19]  Theo Gevers,et al.  Perceptual analysis of distance measures for color constancy algorithms. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[21]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Brian V. Funt,et al.  A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data , 2002, IEEE Trans. Image Process..

[23]  Keigo Hirakawa,et al.  Color Constancy with Spatio-Spectral Statistics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  G. Finlayson,et al.  A Re-evaluation of Colour Constancy Algorithm Performance , 2006 .

[25]  De Xu,et al.  Illumination-independent descriptors using color moment invariants , 2009 .

[26]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Byoung-Ho Kang,et al.  Illumination Estimation via Thin-Plate Spline Interpolation , 2007, CIC.

[28]  Brian V. Funt,et al.  A comparison of computational color constancy Algorithms. II. Experiments with image data , 2002, IEEE Trans. Image Process..

[29]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[30]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Brian V. Funt,et al.  A Large Image Database for Color Constancy Research , 2003, CIC.

[32]  Brian V. Funt,et al.  A data set for color research , 2002 .

[33]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Bing Li,et al.  Evaluating combinational color constancy methods on real-world images , 2011, CVPR 2011.

[35]  Brian V. Funt,et al.  Colour by Correlation in a Three-Dimensional Colour Space , 2000, ECCV.

[36]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[38]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[39]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.