Spectral Gradient: A Surface Reflectance Measurement Invariant to Geometry and Incident Illumination

Although photometric data is a readily available dense source of information in intensity images, it is not widely used in computer vision. A major drawback is its dependence on viewpoint and incident illumination. A novel methodology is presented which extracts reflectivity information of the various materials in the scene independent of incident light and scene geometry. A scene is captured under three different narrow-band color filters and the spectral derivatives of the scene are computed. The resulting spectral derivatives form a spectral gradient at each pixel. This spectral gradient is a surface reflectance descriptor which is invariant to scene geometry and incident illumination for smooth diffuse surfaces. The invariant properties of the spectral gradients make them a particularly appealing tool in many diverse areas of computer vision such as color constancy, tracking, scene classification, material classification, stereo correspondence, even re-illumination of a scene. Comments University of Pennsylvania Department of Computer and Information Science Technical Report No. MSCIS-99-02. This technical report is available at ScholarlyCommons: http://repository.upenn.edu/cis_reports/111 1 Spectral Gradient: A Surface Reflectance Measurement Invariant to Geometry and Incident Illumination Technical Report MS-CIS-99-02 Abstract Although photometric data is a readily available dense source of information in intensity images, it is not widely used in computer vision. A major drawback is its dependence on viewpoint and incident illumination. A novel methodology is presented which extracts reflectivity information of the various materials in the scene independent of incident light and scene geometry. A scene is captured under three different narrow-band color filters and the spectral derivatives of the scene are computed. The resulting spectral derivatives form a spectral gradient at each pixel. This spectral gradient is a surface reflectance descriptor which is invariant to scene geometry and incident illumination for smooth diffuse surfaces. The invariant properties of the spectral gradients make them a particularly appealing tool in many diverse areas of computer vision such as color constancy, tracking, scene classification, material classification, stereo correspondence, even re-illumination of a scene.Although photometric data is a readily available dense source of information in intensity images, it is not widely used in computer vision. A major drawback is its dependence on viewpoint and incident illumination. A novel methodology is presented which extracts reflectivity information of the various materials in the scene independent of incident light and scene geometry. A scene is captured under three different narrow-band color filters and the spectral derivatives of the scene are computed. The resulting spectral derivatives form a spectral gradient at each pixel. This spectral gradient is a surface reflectance descriptor which is invariant to scene geometry and incident illumination for smooth diffuse surfaces. The invariant properties of the spectral gradients make them a particularly appealing tool in many diverse areas of computer vision such as color constancy, tracking, scene classification, material classification, stereo correspondence, even re-illumination of a scene.

[1]  G. Healey,et al.  Illumination-invariant recognition of texture in color images , 1995 .

[2]  Glenn Healey,et al.  Object recognition using invariant profiles , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mark S. Drew,et al.  Separating a Color Signal into Illumination and Surface Reflectance Components: Theory and Applications , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Glenn Healey,et al.  What is the spectral dimensionality of illumination functions in outdoor scenes? , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  L. B. Wolff.  Diffuse-reflectance model for smooth dielectric surfaces , 1994 .

[7]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Sang Wook Lee,et al.  Using chromaticity distributions and eigenspace analysis for pose-, illumination-, and specularity-invariant recognition of 3D objects , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  M. S. Drew,et al.  Color constancy - Generalized diagonal transforms suffice , 1994 .

[11]  Tapas Kanungo,et al.  Hierarchical organization of appearance-based parts and relations for object recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[12]  G. Healey,et al.  Global color constancy: recognition of objects by use of illumination-invariant properties of color distributions , 1994 .

[13]  Linda G. Shapiro,et al.  Appearance-Based 3D Object Recognition , 1994, Object Representation in Computer Vision.

[14]  Glenn Healey,et al.  Using a spectral reflectance model for the illumination-invariant recognition of local image structure , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Shree K. Nayar,et al.  An Experimental Comparison of Appearance and Geometric Model Based Recognition , 1996, Object Representation in Computer Vision.

[16]  Ronen Basri,et al.  Comparing images under variable illumination , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[17]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[18]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[19]  Brian V. Funt,et al.  Color Constancy for Scenes with Varying Illumination , 1997, Comput. Vis. Image Underst..

[20]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[21]  Daniel Berwick,et al.  A chromaticity space for specularity, illumination color- and illumination pose-invariant 3-D object recognition , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[23]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[24]  Glenn Healey,et al.  The Illumination-Invariant Recognition of 3D Objects Using Local Color Invariants , 1996, IEEE Trans. Pattern Anal. Mach. Intell..