The Analysis and Recognition of Real-World Textures in Three Dimensions

The observed image texture for a rough surface has a complex dependence on the illumination and viewing angles due to effects such as foreshortening, local shading, interreflections, and the shadowing and occlusion of surface elements. We introduce the dimensionality surface as a representation for the visual complexity of a material sample. The dimensionality surface defines the number of basis textures that are required to represent the observed textures for a sample as a function of ranges of illumination and viewing angles. Basis textures are represented using multiband correlation functions that consider both within and between color band correlations. We examine properties of the dimensionality surface for real materials using the Columbia Utrecht Reflectance and Texture (CUReT) database. The analysis shows that the dependence of the dimensionality surface on ranges of illumination and viewing angles is approximately linear with a slope that depends on the complexity of the sample. We extend the analysis to consider the problem of recognizing rough surfaces in color images obtained under unknown illumination and viewing geometry. We show, using a set of 12,505 images from 61 material samples, that the information captured by the multiband correlation model allows surfaces to be recognized over a wide range of conditions. We also show that the use of color information provides significant advantages for three-dimensional texture recognition.

[1]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Glenn Healey,et al.  COLOR IN COMPUTER VISION: RECENT PROGRESS , 1999 .

[3]  J. Koenderink,et al.  Phenomenological description of bidirectional surface reflection , 1998 .

[4]  Jitendra Malik,et al.  On perpendicular texture or: Why do we see more flowers in the distance? , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[6]  Lisa M. Brown,et al.  Surface orientation from projective foreshortening of isotropic texture autocorrelation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  J. Gibson.  The perception of visual surfaces. , 1950, The American journal of psychology.

[8]  Lisa M. Brown,et al.  Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  John Krumm,et al.  Texture segmentation and shape in the same image , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  G. Healey,et al.  Illumination-invariant recognition of texture in color images , 1995 .

[11]  S K Nayar,et al.  Visual appearance of matte surfaces , 1995, Science.

[12]  K NayarShree,et al.  Reflectance and texture of real-world surfaces , 1999 .

[13]  Jitendra Malik,et al.  A differential method for computing local shape-from-texture for planar and curved surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[15]  Shree K. Nayar,et al.  Histogram model for 3D textures , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Fernand S. Cohen,et al.  Local Surface Shape Estimation of 3-D Textured Surfaces using Gaussian Markov Random Fields and Stereo Windows , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Glenn Healey,et al.  Use of invariants for recognition of three-dimensional color textures , 1994 .

[18]  Alan C. Bovik,et al.  Shape from Texture Using Local Spectral Moments , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  L. B. Wolff.  Diffuse-reflectance model for smooth dielectric surfaces , 1994 .

[20]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[21]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[22]  Roland T. Chin,et al.  Shape from texture using the Wigner distribution , 1990, Comput. Vis. Graph. Image Process..

[23]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[24]  Andrea J. van Doorn,et al.  Bidirectional Reflection Distribution Function Expressed in Terms of Surface Scattering Modes , 1996, ECCV.

[25]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[26]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[27]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[28]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .