Shape from periodic texture using the spectrogram

It is shown how local spatial image frequency is related to the surface normal of a textured surface. It is found that the Fourier power spectra of any two similarly textured patches on a plane are approximately related to each other by an affine transformation. The transformation parameters are a function of the plane's surface normal. This relationship is used as the basis of an algorithm for finding surface normals of textured shapes using the spectrogram, which is one type of local spatial frequency representation. The relationship is validated by testing the algorithm on real textures. By analyzing shape and texture in terms of the local spatial frequency representation, the advantages of the representation for the shape-from-texture problem can be exploited. Specifically, the algorithm requires no feature detection and can give correct results even when the texture is aliased.<<ETX>>

[1]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Roland T. Chin,et al.  Shape from texture using the Wigner distribution , 1990, Comput. Vis. Graph. Image Process..

[3]  Andrew Blake,et al.  Shape from Texture: Estimation, Isotropy and Moments , 1990, Artif. Intell..

[4]  F. Harris.  On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[5]  David J. DeFatta,et al.  Digital Signal Processing: A System Design Approach , 1988 .

[6]  T. Claasen,et al.  THE WIGNER DISTRIBUTION - A TOOL FOR TIME-FREQUENCY SIGNAL ANALYSIS , 1980 .

[7]  N. Gramenopoulos.  Terrain type recognition using ERTS-1 MSS images , 1973 .

[8]  Harry Wechsler,et al.  Segmentation of Textured Images and Gestalt Organization Using Spatial/Spatial-Frequency Representations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[10]  Ruzena Bajcsy,et al.  Computer Description of Textured Surfaces , 1973, IJCAI.

[11]  一岡 芳樹,et al.  J. D. Gaskill: Linear Systems, Fourier Transforms, and Optics, John Wiley & Sons, New York, 1978, xiv+554ページ, 23.5×15.5cm, $24.96 (Wiley Sons in Pure and Applied Optics). , 1979 .

[12]  John Krumm,et al.  Local Spatial Frequency Analysis for Computer Vision , 1990 .

[13]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Makoto Nagao,et al.  Structural analysis of natural textures by Fourier transformation , 1983, Comput. Vis. Graph. Image Process..

[16]  Lisa M. Brown,et al.  Surface orientation from projective foreshortening of isotropic texture autocorrelation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  John Krumm,et al.  Local spatial frequency analysis of image texture , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[18]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[19]  Alan C. Bovik,et al.  Three-dimensional orientation from texture using Gabor wavelets , 1991, Other Conferences.

[20]  J. Gibson.  The perception of visual surfaces. , 1950, The American journal of psychology.

[21]  A. Papoulis.  Linear systems, Fourier transforms, and optics , 1981, Proceedings of the IEEE.

[22]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[23]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .