Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation

We present a computational model and algorithm for detecting diffuse and specular interface reflections and some inter-reflections. Our color reflection model is based on the dichromatic model for dielectric materials and on a color space, called S space, formed with three orthogonal basis functions. We transform color pixels measured in RGB into the S space and analyze color variations on objects in terms of brightness, hue and saturation which are defined in the S space. When transforming the original RGB data into the S space, we discount the scene illumination color that is estimated using a white reference plate as an active probe. As a result, the color image appears as if the scene illumination is white. Under the whitened illumination, the interface reflection clusters in the S space are all aligned with the brightness direction. The brightness, hue and saturation values exhibit a more direct correspondence to body colors and to diffuse and specular interface reflections, shading, shadows and inter-reflections than the RGB coordinates. We exploit these relationships to segment the color image, and to separate specular and diffuse interface reflections and some inter-reflections from body reflections. The proposed algorithm is effications for uniformly colored dielectric surfaces under singly colored scene illumination. Experimental results conform to our model and algorithm within the liminations discussed.

[1]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[2]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[3]  J. Cohen Dependency of the spectral reflectance curves of the Munsell color chips , 1964 .

[4]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[5]  J. Beck Surface color perception , 1972 .

[6]  Keith Price,et al.  Picture Segmentation Using a Recursive Region Splitting Method , 1998 .

[7]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[8]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[9]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[10]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[11]  K. Nassau,et al.  The Physics and Chemistry of Color , 1985 .

[12]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[13]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[14]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[15]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[16]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[17]  Brian A. Wandell,et al.  The Synthesis and Analysis of Color Images , 1992, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  R. Gershon The use of color in computational vision , 1987 .

[19]  Glenn Healey,et al.  A color metric for computer vision , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[21]  Andrew Blake,et al.  Detecting Specular Reflections Using Lambertian Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[22]  David A. Forsyth,et al.  A Novel Approach To Colour Constancy , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[23]  Sang Wook Lee,et al.  Computational Aspects of Color Constancy , 1989 .

[24]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[25]  Glenn Healey,et al.  Using color for geometry-insensitive segmentation , 1989 .

[26]  Lawrence B. Wolff,et al.  Using polarization to separate reflection components , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[28]  Hsien-Che Lee,et al.  Modeling Light Reflection for Computer Color Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  R. Bajcsy,et al.  Color image segmentation with detection of highlights and local illumination induced by inter-reflections , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[30]  Steven A. Shafer,et al.  Supervised color constancy using a color chart , 1990 .

[31]  Jong-Seok Park,et al.  Highlight separation and surface orientations for 3-D specular objects , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[32]  Ruzena Bajcsy,et al.  Segmentation as the search for the best description of the image in terms of primitives , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[33]  B. Wandell,et al.  Component estimation of surface spectral reflectance , 1990 .

[34]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[35]  Takeo Kanade,et al.  Introduction to the Special Issue on Physical Modeling in Computer Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  L. B. Wolff Polarization methods in computer vision , 1991 .

[37]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Huang Yumin,et al.  A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING , 1991 .

[39]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Sang Wook Lee,et al.  Detection of specularity using colour and multiple views , 1992, Image Vis. Comput..

[41]  Steven A. Shafer,et al.  Anatomy of a color histogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Sang Wook Lee,et al.  Detection of Specularity Using Color and Multiple Views , 1992, ECCV.

[43]  S. W. Lee Understanding of surface reflections in computer vision by color and multiple views , 1992 .

[44]  Mark S. Drew,et al.  Color Space Analysis of Mutual Illumination , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Ruzena Bajcsy,et al.  Active Color Image Analysis for Recognizing Shadows , 1993, IJCAI.

[46]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[47]  Takeo Kanade,et al.  Shape from interreflections , 2004, International Journal of Computer Vision.