Names and shades of color for intrinsic image estimation

In the last years, intrinsic image decomposition has gained attention. Most of the state-of-the-art methods are based on the assumption that reflectance changes come along with strong image edges. Recently, user intervention in the recovery problem has proved to be a remarkable source of improvement. In this paper, we propose a novel approach that aims to overcome the shortcomings of pure edge-based methods by introducing strong surface descriptors, such as the color-name descriptor which introduces high-level considerations resembling top-down intervention. We also use a second surface descriptor, termed color-shade, which allows us to include physical considerations derived from the image formation model capturing gradual color surface variations. Both color cues are combined by means of a Markov Random Field. The method is quantitatively tested on the MIT ground truth dataset using different error metrics, achieving state-of-the-art performance.

[1]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Stephen Lin,et al.  Estimating Intrinsic Images from Image Sequences with Biased Illumination , 2004, ECCV.

[3]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[5]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Joost van de Weijer,et al.  Object recoloring based on intrinsic image estimation , 2011, 2011 International Conference on Computer Vision.

[9]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[10]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[11]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[13]  Mark S. Drew,et al.  Recovering Shading from Color Images , 1992, ECCV.

[14]  Sylvain Paris,et al.  User-assisted intrinsic images , 2009, ACM Trans. Graph..

[15]  Xiaoyue Jiang,et al.  Correlation-Based Intrinsic Image Extraction from a Single Image , 2010, ECCV.

[16]  M. Vanrell,et al.  Parametric fuzzy sets for automatic color naming. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Lewis D. Griffin,et al.  Optimality of the basic colour categories for classification , 2006, Journal of The Royal Society Interface.

[18]  P. Kay Basic Color Terms: Their Universality and Evolution , 1969 .

[19]  Joost van de Weijer,et al.  Describing Reflectances for Color Segmentation Robust to Shadows, Highlights, and Textures , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Edward H. Adelson,et al.  Estimating Intrinsic Component Images using Non-Linear Regression , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Xuelong Li,et al.  Intrinsic images using optimization , 2011, CVPR 2011.

[22]  Chuohao Yeo,et al.  Intrinsic images decomposition using a local and global sparse representation of reflectance , 2011, CVPR 2011.

[23]  Robert Benavente,et al.  A data set for fuzzy colour naming , 2006 .