Direct estimation of affine image deformations using visual front-end operations with automatic scale selection

This article deals with the problem of estimating deformations of brightness patterns using visual front-end operations. Estimating such deformations constitutes an important subtask in several computer vision problems relating to image correspondence and shape estimation. The following subjects are treated: The problem of decomposing affine flow fields into simpler components is analysed in detail. A canonical parametrization is presented based on singular value decomposition, which naturally separates the rotationally invariant components of the flow field from the rotationally variant ones. A novel mechanism is presented for automatic selection of scale levels when estimating local affine deformations. This mechanism is expressed within a multiscale framework where disparity estimates are computed in a hierarchical coarse-to-fine manner and corrected using iterative techniques. Then, deformation estimates are selected from the scales that minimize a certain normalized residual over scales. Finally, the descriptors so obtained serve as initial data for computing refined estimates of the local deformations.<<ETX>>

[1]  T. Lindeberg.  Direct Estimation of Affine Deformations of Brightness Patterns Using Visual Front-End O , 1995 .

[2]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[3]  R. Manmatha.  Measuring the Affine Transform Using Gaussian Filters , 1994, ECCV.

[4]  J. Koenderink,et al.  Extraction of motion parallax structure in the visual system I , 2004, Biological Cybernetics.

[5]  Tony Lindeberg,et al.  Shape from texture from a multi-scale perspective , 1993, 1993 (4th) International Conference on Computer Vision.

[6]  Jitendra Malik,et al.  Computational framework for determining stereo correspondence from a set of linear spatial filters , 1992, Image Vis. Comput..

[7]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[8]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[9]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[10]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[11]  Roberto Cipolla,et al.  Extracting the Affine Transformation from Texture Moments , 1994, ECCV.

[12]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[13]  Luc Van Gool,et al.  Determination of Optical Flow and its Discontinuities using Non-Linear Diffusion , 1994, ECCV.

[14]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.