Optimal Solution of the Dichromatic Model for Multispectral Photometric Invariance

In this paper, we address the problem of photometric invariance in multispectral imaging making use of an optimisation approach based upon the dichromatic model. In this manner, we can cast the problem of recovering the spectra of the illuminant, the surface reflectance and the shading and specular factors in a structural optimisation setting. Making use of the additional information provided by multispectral imaging and the structure of image patches, we recover the dichromatic parameters of the scene. Thus, we formulate a target cost function combining the dichromatic error and the smoothness priors for surfaces with uniform reflectance. The dichromatic parameters are recovered through minimising this cost function in a coordinate descent manner. To this end, we make use of regular albedo patches in the scene selected automatically. The algorithm is shown to be robust, and since the cost function is convex in nature, the resulting solution is globally optimal. We illustrate the effectiveness of our method for purposes of illuminant spectrum recovery and skin recognition. We also compare our results to a number of alternatives.

[1]  Huang Yumin,et al.  A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING , 1991 .

[2]  Shree K. Nayar,et al.  Reflectance based object recognition , 1996, International Journal of Computer Vision.

[3]  Stephen Lin,et al.  Separation of diffuse and specular reflection in color images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Gerald Schaefer,et al.  Convex and non-convex illuminant constraints for dichromatic colour constancy , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[6]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[7]  Glenn Healey,et al.  Invariant mixture recognition in hyperspectral images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Elli Angelopoulou,et al.  Objective Colour from Multispectral Imaging , 2000, ECCV.

[9]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shree K. Nayar,et al.  Computing reflectance ratios from an image , 1993, Pattern Recognit..

[11]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Edward H. Adelson,et al.  Estimating surface reflectance properties from images under unknown illumination , 2001, IS&T/SPIE Electronic Imaging.

[13]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[14]  Edwin R. Hancock,et al.  A probabilistic framework for specular shape-from-shading , 2002, Object recognition supported by user interaction for service robots.

[15]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[16]  Andrew Blake,et al.  Detecting Specular Reflections Using Lambertian Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[17]  E. Adelson,et al.  Recognition of Surface Reflectance Properties from a Single Image under Unknown Real-World Illumination , 2001 .

[18]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[19]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.