Unsupervised illuminant estimation from natural scenes: an RGB digital camera suffices.

A linear pseudo-inverse method for unsupervised illuminant recovery from natural scenes is presented. The algorithm, which uses a digital RGB camera, selects the naturally occurring bright areas (not necessarily the white ones) in natural images and converts the RGB digital counts directly into the spectral power distribution of the illuminants using a learning-based spectral procedure. Computations show a good spectral and colorimetric performance when only three sensors (a three-band RGB camera) are used. These results go against previous findings concerning the recovery of spectral reflectances and radiances, which claimed that the greater the number of sensors, the better the spectral performance. Combining the device with the appropriate computations can yield spectral information about objects and illuminants simultaneously, avoiding the need for spectroradiometric measurements. The method works well and needs neither a white reference located in the natural scene nor direct measurements of the spectral power distribution of the light.

[1]  Nobuyuki Otsu,et al.  ATlreshold Selection Method fromGray-Level Histograms , 1979 .

[2]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[3]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[4]  Brian A. Wandell,et al.  The Synthesis and Analysis of Color Images , 1992, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[6]  M. D'Zmura,et al.  Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[8]  Shoji Tominaga,et al.  MULTICHANNEL VISION SYSTEM FOR ESTIMATING SURFACE AND ILLUMINATION FUNCTIONS , 1996 .

[9]  M. J. Luque,et al.  Implementations of a novel algorithm for colour constancy , 1997, Vision Research.

[10]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Jon Yngve Hardeberg Acquisition and reproduction of colour images: colorimetric and multi-spectral approaches , 1999 .

[12]  Roy S. Berns,et al.  Spectral Estimation Using Trichromatic Digital Cameras , 1999 .

[13]  Brian V. Funt,et al.  Committee-Based Color Constancy , 1999, CIC.

[14]  C C Chiao,et al.  Characterization of natural illuminants in forests and the use of digital video data to reconstruct illuminant spectra. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. Hernández-Andrés,et al.  Color and spectral analysis of daylight in southern Europe. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Shoji Tominaga Natural image database and its use for scene illuminant estimation , 2002, J. Electronic Imaging.

[18]  B. Wandell,et al.  Natural scene-illuminant estimation using the sensor correlation , 2002, Proc. IEEE.

[19]  Roy S. Berns,et al.  Comparative Study of Metrics for Spectral Match Quality , 2002, CGIV.

[20]  Flávio P. Ferreira,et al.  Statistics of spatial cone-excitation ratios in natural scenes. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[22]  Gerald Schaefer Robust Dichromatic Colour Constancy , 2004, ICIAR.

[23]  Noriyuki Shimano,et al.  Evaluation of a multispectral image acquisition system aimed at reconstruction of spectral reflectances , 2005 .

[24]  Gerald Schaefer,et al.  A combined physical and statistical approach to colour constancy , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Changjun Li,et al.  Characterization of trichromatic color cameras by using a new multispectral imaging technique. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Javier Hernández-Andrés,et al.  Multispectral synthesis of daylight using a commercial digital CCD camera. , 2005, Applied optics.

[27]  S. D. Hordley,et al.  Reevaluation of color constancy algorithm performance. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Javier Hernández-Andrés,et al.  Selecting algorithms, sensors, and linear bases for optimum spectral recovery of skylight. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  Hui-Liang Shen,et al.  Improved reflectance reconstruction for multispectral imaging by combining different techniques. , 2007, Optics express.

[30]  Kinjiro Amano,et al.  Recovering spectral data from natural scenes with an RGB digital camera and colored filters , 2007 .

[31]  Javier Hernández-Andrés,et al.  Recovering fluorescent spectra with an RGB digital camera and color filters using different matrix factorizations. , 2007, Applied optics.

[32]  Brian V. Funt,et al.  Multispectral color constancy: real image tests , 2007, Electronic Imaging.