Metamer-set-based approach to estimating surface reflectance from camera RGB.

We present an approach to estimating the reflectance of a surface given its camera response. In this approach we first solve the general form of this problem: we calculate the set of all possible surface reflectances, called the metamer set, and then choose a member from this set. Three possibilities in choosing a single reflectance are described here. First, we assume that all reflectances are equally likely and minimize worst-case error. Second, we adopt the assumption that reflectances follow a normal probability distribution and maximize this probability. Finally, we assume that reflectances are smooth and maximize this property. The results of our experiments show that there is significant benefit from the proposed approach in terms of the accuracy of the estimation compared with that of standard estimation methods. Moreover, the present approach introduces a notion of robustness of estimates in the form of error bars.

[1]  James A. Worthey.  Spectrally Smooth Reflectances that Match , 1994 .

[2]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[3]  J. Dannemiller.  Spectral reflectance of natural objects: how many basis functions are necessary? , 1992 .

[4]  John K. Tsotsos,et al.  From [R, G, B] to Surface Reflectance: Computing Color Constant Descriptors in Images , 1987, IJCAI.

[5]  B A Wandell,et al.  Linear models of surface and illuminant spectra. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[6]  D. B. Judd,et al.  Final Report of the O.S.A. Subcommittee on the Spacing of the Munsell Colors , 1943 .

[7]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[8]  L. Maloney.  Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[9]  Noriyuki Shimano.  Illuminant Invariant Recovery of Surface Reflectances and Estimation of Colorimetric Values from Image Signals , 1997 .

[10]  Raimondo Schettini.  Deriving Spectral, Reflectance Functions of Computer‐Simulated Object Colours , 1994, Comput. Graph. Forum.

[11]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Brent Smith,et al.  Numerical methods for colorimetric calculations: Sampling density requirements , 1992 .

[13]  W L BREWER,et al.  Syntheses of spectral-distribution curves. , 1948, Journal of the Optical Society of America.

[14]  C. van Trigt,et al.  Smoothest reflectance functions. I. Definition and main results , 1990 .

[15]  Changjun Li,et al.  The Estimation of Spectral Reflectances Using the Smoothest Constraint Condition , 2001, Color Imaging Conference.

[16]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[17]  M. Kuittinen,et al.  Spectral representation of color images , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[18]  Y. Nayatani,et al.  New Method for Generating Metameric Stimuli of Object Colors , 1972 .

[19]  J. Parkkinen,et al.  Characteristic spectra of Munsell colors , 1989 .

[20]  Noriyuki SHIMANO.  Recovery of Surface Reflectances Using Video Camera Image Signals under Unknown Illuminations , 1997 .

[21]  J. Maxwell,et al.  The Scientific Papers of James Clerk Maxwell: Experiments on Colour as perceived by the Eye, with remarks on Colour-Blindness , 2011 .

[22]  Noboru Ohta.  Generating metameric object colors , 1975 .

[23]  Mark S. Drew,et al.  Natural metamers , 1992, CVGIP: Image Understanding.

[24]  Günter Wyszecki,et al.  Evaluation of Metameric Colors , 1958 .

[25]  S. Zuffi,et al.  Estimating Surface Reflectance Functions from Tristimulus Values , 2004 .

[26]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .