Robust point correspondence by concave minimization

We propose a new methodology for reliably solving the correspondence problem between points of two or more images. This is a key step in most problems of Computer Vision and, so far, no general method exists to solve it. Our methodology is able to handle most of the commonly used assumptions in a unique formulation, independent of the domain of application and type of features. It performs correspondence and outlier rejection in a single step, and achieves global optimality with feasible computation. Feature selection and correspondence are first formulated as an integer optimization problem. This is a blunt formulation, which considers the whole combinatorial space of possible point selections and correspondences. To find its global optimal solution we build a concave objective function and relax the search domain into its convex-hull. The special structure of this extended problem assures its equivalence to the original one, but it can be optimally solved by efficient algorithms that avoid combinatorial search.

[1]  Subhashis Banerjee,et al.  Finding Point Correspondences in Motion Sequences Preserving Affine Structure , 1997, Comput. Vis. Image Underst..

[2]  A. Victor Cabot,et al.  Solving Certain Nonconvex Quadratic Minimization Problems by Ranking the Extreme Points , 1970, Oper. Res..

[3]  J. B. Rosen,et al.  Methods for global concave minimization: A bibliographic survey , 1986 .

[4]  P. Maher,et al.  Handbook of Matrices , 1999, The Mathematical Gazette.

[5]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[6]  Stein W. Wallace Pivoting rules and redundancy schemes in extreme point enumeration , 1985 .

[7]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[8]  Kalle Åström,et al.  Reconstruction of 3D-curves from 2D-images using affine shape methods for curves , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Karl Johan Åström,et al.  Projective Reconstruction of 3D-curves from its 2D-images using Error Models and Bundle Adjustments , 1997 .

[11]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[13]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.