Color Space Analysis of Mutual Illumination

Mutual illumination occurs when light reflected from one surface impinges on a second one. The resulting additional illumination incident on the second surface affects both the color and intensity of the light reflected from it. As a consequence, the image of a surface in the presence of mutual illumination differs from what it otherwise would have been in the absence of mutual illumination. Unaccounted for mutual illumination can easily confuse methods that rely on intensity or color such as shape-from-shading or color-based object recognition. In this correspondence, we introduce an algorithm that removes mutual illumination effects from images. The domain is that of previously-segmented images of convex surfaces of uniform color and diffuse reflectance where for each surface the interreflection occurs mainly from one other surface and can be accurately accounted for within a one-bounce model. The algorithm is based on a singular value decomposition of the colors coming from each surface. Geometrical information about where on the surface the colors emanate from is not required. The RGB triples from a single convex surface experiencing interreflection fall in a plane; intersecting the planes generated from two interreflecting surfaces results in a unique interreflection color. Each pixel can then be factored into its interreflection and no-interreflection components so that a complete no-interreflection image is produced. >

[1]  E. A. Sylvestre,et al.  Self Modeling Curve Resolution , 1971 .

[2]  David A. Forsyth,et al.  Shape from shading in the light of mutual illumination , 1990, Image and Vision Computing.

[3]  M. Pinar Mengüç,et al.  Thermal Radiation Heat Transfer , 2020 .

[4]  Mark S. Drew,et al.  Separating a Color Signal into Illumination and Surface Reflectance Components: Theory and Applications , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  M H Brill,et al.  Image segmentation by object color: a unifying framework and connection to color constancy. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[6]  B. Wandell,et al.  Component estimation of surface spectral reflectance , 1990 .

[7]  R. Bajcsy,et al.  Color image segmentation with detection of highlights and local illumination induced by inter-reflections , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[8]  K Sasaki,et al.  Component analysis of spatial and spectral patterns in multispectral images. I. Basis. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  David A. Forsyth,et al.  Shape from shading in the light of mutual illumination , 1990, Image Vis. Comput..

[10]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[11]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[12]  Frank C. H Tong,et al.  Specularity removal for shape-from-shading , 1987 .

[13]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[14]  Brian V. Funt,et al.  Removing Specularities from Color Images for Shape from Shading , 1989, Computer Vision and Shape Recognition.

[15]  Mark S. Drew,et al.  Calculating surface reflectance using a single-bounce model of mutual reflection , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[16]  Takeo Kanade,et al.  Physics-based models for early vision by machine , 1990, Electronic Imaging.

[17]  Berthold K. P. Horn Understanding Image Intensities , 1977, Artif. Intell..

[18]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[19]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.