Shape from Texture Via Fourier Analysis

Many models and algorithms have been proposed since the shape from texture problem was tackled by the pioneering work of Gibson in 1950. In the present work, a general assumption of stochastic homogeneity is chosen so as to include a wide range of natural textures. Under this assumption, the Fourier transform of the image and a minimal set of Gabor filters are used to efficiently estimate all the main local spatial frequencies of the texture, i.e. so as to compute distortion measures. Then a known method which uses singular value decomposition to process the frequencies under orthographic projection is considered. The method is extended to general perspective cases and used to reconstruct the 3D shape of real pictures and video sequences. The robustness of the algorithm is proven on general shapes, and results are compared with the literature when possible.

[1]  Stéphane Mallat,et al.  The Texture Gradient Equation for Recovering Shape from Texture , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. U.S.,et al.  Recovering Surface Shape and Orientation from Texture , 2002 .

[3]  Angeline M. Loh,et al.  Shape from Non-homogeneous, Non-stationary, Anisotropic, Perspective Texture , 2005, BMVC.

[4]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[5]  R. Hetherington The Perception of the Visual World , 1952 .

[6]  Alan C. Bovik,et al.  Planar surface orientation from texture spatial frequencies , 1995, Pattern Recognit..

[7]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Edwin R. Hancock,et al.  Estimating the perspective pose of texture planes using spectral analysis on the unit sphere , 2002, Pattern Recognit..

[9]  Jeanny Hérault,et al.  Model of Frequency Analysis in the Visual Cortex and the Shape from Texture Problem , 2008, International Journal of Computer Vision.

[10]  Jitendra Malik,et al.  Computing Local Surface Orientation and Shape from Texture for Curved Surfaces , 1997, International Journal of Computer Vision.

[11]  Jonas Gårding,et al.  Shape from texture for smooth curved surfaces in perspective projection , 1992, Journal of Mathematical Imaging and Vision.

[12]  Joan Lasenby,et al.  Shape from Texture of Developable Surfaces Via Fourier Analysis , 2007, ISVC.

[13]  Alan C. Bovik,et al.  Shape from Texture Using Local Spectral Moments , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Dennis Gabor,et al.  Theory of communication , 1946 .