Matching disparate views of planar surfaces using projective invariants

Feature matching is a prerequisite to a wide variety of vision tasks. This paper presents a method that addresses the problem of matching two views of coplanar points and lines in a unified manner. The views to be matched are assumed to have been acquired from disparate, i.e. very different viewpoints. By employing a randomized search strategy combined with the two-line two-point projective invariant, the proposed method is able to derive small sets of possibly matching points and lines. These candidate matches are then verified by recovering the associated plane homography, which is further used to predict more matches. The resulting scheme is capable of successfully matching features extracted from views that differ considerably, even in the presence of large numbers of outlying features. Experimental results from the application of the method to indoor and aerial images indicate its effectiveness and robustness. q 2000 Elsevier Science B.V. All rights reserved.

[1]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Josef Kittler,et al.  On the correspondence problem for wide angular separation of non-coplanar points , 1998, Image Vis. Comput..

[4]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[5]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[6]  Zhengyou Zhang,et al.  A new and efficient iterative approach to image matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[7]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[8]  Ramakant Nevatia,et al.  Matching Images Using Linear Features , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Kenichi Kanatani,et al.  Computational projective geometry , 1991, CVGIP Image Underst..

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[12]  Patrick Gros,et al.  Using Local Planar Geometric Invariants to Match and Model Images of Line Segments , 1998, Comput. Vis. Image Underst..

[13]  Kenichi Kanatani.  Computational cross ratio for computer vision , 1994 .

[14]  Olivier D. Faugeras,et al.  Determining the fundamental matrix with planes: instability and new algorithms , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Amnon Shashua,et al.  Projective Structure from Uncalibrated Images: Structure From Motion and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Günter Ewald,et al.  Geometry: an introduction , 1971 .

[17]  Manolis I. A. Lourakis,et al.  Camera Self-Calibration Using the Singular Value Decomposition of the Fundamental Matrix: From Point Correspondences to 3D Measurements , 1999 .

[18]  Edward M. Riseman,et al.  The non-existence of general-case view-invariants , 1992 .

[19]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[20]  Andrew Zisserman,et al.  Wide baseline stereo matching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Michael Ian Shamos,et al.  Computational geometry: an introduction , 1985 .

[22]  Andrew Zisserman,et al.  Robust computation and parametrization of multiple view relations , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Roger Mohr,et al.  Projective Geometry and Computer Vision , 1993, Handbook of Pattern Recognition and Computer Vision.

[25]  W. Grimson,et al.  Affine matching of planar sets , 1998 .

[26]  Christoph Schnörr,et al.  A robust and convergent iterative approach for determining the dominant plane from two views without correspondence and calibration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Manolis I. A. Lourakis,et al.  Visual Detection of Obstacles Assuming a Locally Planar Ground , 1998, ACCV.

[28]  Rachid Deriche,et al.  Using geometric corners to build a 2D mosaic from a set of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Rajesh P. N. Rao,et al.  An Active Vision Architecture Based on Iconic Representations , 1995, Artif. Intell..

[30]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[31]  James H. McIntosh,et al.  Matching straight lines , 1988, Comput. Vis. Graph. Image Process..

[32]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[33]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[34]  Radu Horaud,et al.  Stereo Correspondence Through Feature Grouping and Maximal Cliques , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.