A differential method for computing local shape-from-texture for planar and curved surfaces

We model the texture distortion at a point in any particular direction on the image plane as an affine transformation and derive the relationship between the parameters of the affine transformation and the surface shape and orientation. We use a technique for estimating affine transforms between nearby image patches which is based on solving a system of linear constraints derived from a differential analysis. It is not necessary to explicitly identify texels or make restrictive assumptions about the nature of the image texture like isotropy. We have developed two different algorithms for recovering surface orientation and shape based on the estimated affine transforms in a number of different directions. The first is a sample linear algorithm based on singular value decomposition. The second is based on nonlinear minimization of a least squares error criterion. Experimental results are presented on images of planar and curved surfaces under perspective projection.<<ETX>>

[1]  Stanley M. Dunn,et al.  Efficient Recovery of Shape from Texture , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Katsushi Ikeuchi,et al.  Shape from Regular Patterns , 1984, Artif. Intell..

[3]  J. Aloimonos.  Shape from texture , 1988, Biological cybernetics.

[4]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[5]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Andrew Blake,et al.  Shape from Texture: Estimation, Isotropy and Moments , 1990, Artif. Intell..

[7]  Lisa M. Brown,et al.  Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Andrew Blake,et al.  Shape from texture: the homogeneity hypothesis , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[9]  Jonas Gårding,et al.  Shape from Texture for Smooth Curved Surfaces , 1992, ECCV.

[10]  Alan C. Bovik,et al.  Shape-from-texture by wavelet-based measurement of local spectral moments , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Jitendra Malik,et al.  A differential method for computing local shape-from-texture for planar and curved surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Tony Lindeberg,et al.  Shape from texture from a multi-scale perspective , 1993, 1993 (4th) International Conference on Computer Vision.