Detection of specularity using colour and multiple views

This paper presents a model and an algorithm for the detection of specularities from Lambertian reflections using multiple color images from different viewing directions. The algorithm, called spectral differencing, is based on the Lambertian consistency that color image irradiance from Lambertian reflection at an object surface does not change depending on viewing directions, but color image irradiance from specular reflection or from a mixture of Lambertian and specular reflections does change. The spectral differencing is a pixelwise parallel algorithm, and it detects specularities by color differences between a small number of images without using any feature correspondence or image segmentation. Applicable objects include uniformly or nonuniformly colored dielectrics and metals, under extended and multiply colored scene illumination. Experimental results agree with the model, and the algorithm performs well within the limitations discussed.

[1]  Takeo Kanade,et al.  Image Segmentation And Reflection Analysis Through Color , 1988, Defense, Security, and Sensing.

[2]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[3]  Andrew Blake,et al.  Detecting Specular Reflections Using Lambertian Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[4]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[5]  Hsien-Che Lee,et al.  Modeling Light Reflection for Computer Color Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[7]  J. Cohen Dependency of the spectral reflectance curves of the Munsell color chips , 1964 .

[8]  R. Bajcsy,et al.  Color image segmentation with detection of highlights and local illumination induced by inter-reflections , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[9]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[10]  Lawrence B. Wolff,et al.  Using polarization to separate reflection components , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Glenn Healey,et al.  Using color for geometry-insensitive segmentation , 1989 .

[12]  R. Bajcsy Active perception , 1988 .

[13]  R. Gershon The use of color in computational vision , 1987 .

[14]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[15]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..