Shape from texture for smooth curved surfaces in perspective projection

Projective distortion of surface texture observed in a perspective image can provide direct information about the shape of the underlying surface. Previous theories have generally concerned planar surfaces; this paper presents a systematic analysis of first- and second-order texture distortion cues for the case of a smooth, curved surface. In particular, several kinds of texture gradients are analyzed and are related to surface orientation and surface curvature. The local estimates obtained from these cues can be integrated to obtain a global surface shape, and it is shown that the two surfaces resulting from the well-known tilt ambiguity in the local foreshortening cue typically have qualitatively different shapes. As an example of a practical application of the analysis, a shape-from-texture algorithm based on local orientation-selective filtering is described, and some experimental results are shown.

[1]  J. Gibson.  The perception of the visual world , 1951 .

[2]  B. O'neill.  Elementary Differential Geometry , 1966 .

[3]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[4]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[5]  J. Cutting,et al.  Three Gradients and the Perception of Flat and Curved Surfaces , 1984 .

[6]  J. Cutting,et al.  Three gradients and the perception of flat and curved surfaces. , 1984, Journal of experimental psychology. General.

[7]  Alex Pentland,et al.  Shading into Texture , 1984, Artif. Intell..

[8]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[9]  J. Todd,et al.  Perception of three-dimensional form from patterns of optical texture. , 1987, Journal of experimental psychology. Human perception and performance.

[10]  J. Aloimonos.  Shape from texture , 1988, Biological cybernetics.

[11]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[12]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[14]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Lisa M. Brown,et al.  Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Andrew Blake,et al.  Shape from texture: the homogeneity hypothesis , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Jonas Gårding.  Shape from Texture and Contour by Weak Isotropy , 1993, Artif. Intell..

[18]  A. U.S.,et al.  Recovering Surface Shape and Orientation from Texture , 2002 .

[19]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[20]  K. A. Stevens.  The information content of texture gradients , 1981, Biological Cybernetics.

[21]  Ruzena Bajcsy,et al.  Underestimation of visual texture slant by human observers: a model , 1991, Biological Cybernetics.