Shape from Texture Using Local Spectral Moments

Presents a non-feature-based solution to the problem of computing the shape of curved surfaces from texture information. First, the use of local spatial-frequency spectra and their moments to describe texture is discussed and motivated. A new, more accurate method for measuring the local spatial-frequency moments of an image texture using Gabor elementary functions and their derivatives is presented. Also described is a technique for separating shading from texture information, which makes the shape-from-texture algorithm robust to the shading effects found in real imagery. Second, a detailed model for the projection of local spectra and spectral moments of any surface reflectance patterns (not just textures) is developed. Third, the conditions under which the projection model can be solved for the orientation of the surface at each point are explored. Unlike earlier non-feature-based, curved surface shape-from-texture approaches, the assumption that the surface texture is isotropic is not required; surface texture homogeneity can be assumed instead. The algorithm's ability to operate on anisotropic and nondeterministic textures, and on both smooth- and rough-textured surfaces, is demonstrated. >

[1]  J. Aloimonos Shape from texture , 1988, Biological cybernetics.

[2]  John Krumm,et al.  Shape from periodic texture using the spectrogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Petros Maragos,et al.  Modulation models for image processing and wavelet-based image demodulation , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[4]  D. G. Albrecht,et al.  Motion selectivity and the contrast-response function of simple cells in the visual cortex , 1991, Visual Neuroscience.

[5]  Katsushi Ikeuchi,et al.  Shape from Regular Patterns , 1984, Artif. Intell..

[6]  Alan C. Bovik,et al.  Three-dimensional orientation from texture using Gabor wavelets , 1991, Other Conferences.

[7]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[8]  Alan C. Bovik,et al.  Shape-from-texture by wavelet-based measurement of local spectral moments , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  H. B. Dwight,et al.  Tables of Integrals and Other Mathematical Data , 1934 .

[10]  John R. Kender,et al.  Shape from Texture: An Aggregation Transform that Maps a Class of Textures into Surface Orientation , 1979, IJCAI.

[11]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  N. Ahuja,et al.  Representation and Three-Dimensional Interpretation of Image Texture: An Integrated Approach , 1987 .

[13]  Dennis Gabor,et al.  Theory of communication , 1946 .

[14]  Lisa M. Brown,et al.  Surface orientation from projective foreshortening of isotropic texture autocorrelation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  John Krumm,et al.  Local spatial frequency analysis of image texture , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[16]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[17]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[18]  Toshiyuki Sakai,et al.  Obtaining Surface Orientation from Texels under Perspective Projection , 1981, IJCAI.

[19]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[20]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[21]  Roland T. Chin,et al.  Shape from texture using the Wigner distribution , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Boaz J. Super Filters for directly detecting surface orientation in an image , 1992, Other Conferences.

[23]  Jonas Gårding,et al.  Shape from Texture for Smooth Curved Surfaces , 1992, ECCV.