A differential method for computing local shape-from-texture for planar and curved surfaces

Shape from texture is best analyzed in a two-stage framework: computing the texture gradient from the image, and interpreting the texture gradient to infer the distance and shape of the scene surface in 3-D. The texture distortion is modeled at a point in any particular direction on the image plane as an affine transformation. The parameters of the affine transform are related to the viewer. A technique is developed for estimating affine transforms between nearby image patches. It is based on solving a system of linear constraints derived from a differential analysis. Given the estimated affine transforms in a number of directions, it is possible to recover local shape and orientation of the surface. It is not necessary to explicitly identify texels or make restrictive assumptions about the nature of the image texture. Experimental results are presented on images of planar and curved surfaces under perspective projection.<<ETX>>

[1]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[3]  Katsushi Ikeuchi,et al.  Shape from Regular Patterns , 1984, Artif. Intell..

[4]  Stanley M. Dunn,et al.  Efficient Recovery of Shape from Texture , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  J. Aloimonos Shape from texture , 1988, Biological cybernetics.

[6]  Jonas Gårding,et al.  Shape from Texture for Smooth Curved Surfaces , 1992, ECCV.

[7]  John Krumm,et al.  Shape from periodic texture using the spectrogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Andrew Blake,et al.  Shape from texture: the homogeneity hypothesis , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[9]  Andrew Blake,et al.  Shape from Texture: Estimation, Isotropy and Moments , 1990, Artif. Intell..

[10]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[11]  J. Gibson The perception of the visual world , 1951 .

[12]  J. Cutting,et al.  Three Gradients and the Perception of Flat and Curved Surfaces , 1984 .

[13]  Lisa M. Brown,et al.  Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[15]  R. Marks Introduction to Shannon Sampling and Interpolation Theory , 1990 .

[16]  Alan C. Bovik,et al.  Shape-from-texture by wavelet-based measurement of local spectral moments , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..