Shape-Adapted Smoothing in Estimation of 3-D Depth Cues from Affine Distortions of Local 2-D Brightness Structure

Rotationally symmetric operations in the image domain may give rise to shape distortions. This article describes a way of reducing this effect for a general class of methods for deriving 3-D shape cues from 2-D image data, which are based on the estimation of locally linearized distortion of brightness patterns. By extending the linear scale-space concept into an affine scale-space representation and performing affine shape adaption of the smoothing kernels, the accuracy of surface orientation estimates derived from texture and disparity cues can be improved by typically one order of magnitude. The reason for this is that the image descriptors, on which the methods are based, will be relative invariant under affine transformations, and the error will thus be confined to the higher-order terms in the locally linearized perspective mapping.

[1]  Alan L. Yuille,et al.  Scaling Theorems for Zero Crossings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Lisa M. Brown,et al.  Surface orientation from projective foreshortening of isotropic texture autocorrelation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Niklas Nordström,et al.  Biased anisotropic diffusion: a unified regularization and diffusion approach to edge detection , 1990, Image Vis. Comput..

[7]  James V. Stone Shape from Texture: Textural Invariance and the Problem of Scale in Perspective Images of Textured Surfaces , 1990 .

[8]  Tony Lindeberg,et al.  Scale-Space for Discrete Signals , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[10]  Richard P. Wildes,et al.  Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Mark Nitzberg,et al.  Nonlinear Image Filtering with Edge and Corner Enhancement , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jitendra Malik,et al.  Determining Three-Dimensional Shape from Orientation and Spatial Frequency Disparities , 1991, ECCV.

[13]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[14]  Jitendra Malik,et al.  A differential method for computing local shape-from-texture for planar and curved surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Roberto Cipolla,et al.  Robust structure from motion using motion parallax , 1993, 1993 (4th) International Conference on Computer Vision.

[16]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[17]  Jitendra Malik,et al.  Robust computation of optical flow in a multi-scale differential framework , 1993, 1993 (4th) International Conference on Computer Vision.

[18]  Tony Lindeberg,et al.  Shape from texture from a multi-scale perspective , 1993, 1993 (4th) International Conference on Computer Vision.

[19]  Jitendra Malik,et al.  A differential method for computing local shape-from-texture for planar and curved surfaces , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[20]  T. Lindeberg On Scale Selection for Di erential Operators , 1993 .

[21]  T. Lindeberg On Scale Selection for Diierential Operators , 1993 .

[22]  T. Lindeberg,et al.  Direct computation of shape cues by multi-scale retinotopic processing , 1994 .

[23]  Tony Lindeberg,et al.  Direct Estimation of Local Surface Shape in a Fixating Binocular Vision System , 1994, ECCV.