Robust perspective invariant quasidense matching across large oblique images

Abstract. Large oblique stereo images are of great interest because they have a large coverage and a high reconstruction precision. However, severe distortions are more likely to occur in this type of image. This can make conventional algorithms inaccurate, computationally expensive, and invalid. We present a new robust quasidense image matching algorithm for large oblique images. Our algorithm can be divided into two steps. First, we find a sufficient number of highly accurate seed matches that are uniformly distributed by integrating complementary affine invariant feature matching with least-squares matching. Second, we consider quasidense matches covering overlapping areas of images. We use match propagation beginning with the best seed, iteratively applying the local perspective invariant neighborhood transform (PINT) with the normalized cross-correlation metric. The local PINT is dynamically updated using the current new match set, and the erroneous matches are eliminated according to their geometric consistency. We conducted experiments on simulated and real large oblique images to demonstrate that the proposed algorithm is effective and can robustly find quasidense matches. Comparisons with the existing methods demonstrated that it is superior in terms of accuracy and efficiency.

[1]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[2]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[3]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yang Huachao,et al.  Robust and Precise Registration of Oblique Images Based on Scale-Invariant Feature Transformation Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[5]  Benjamin Albouy,et al.  Robust Semi-Dense Matching across Uncalibrated and Widely Separated Views , 2007, MVA.

[6]  Mubarak Shah,et al.  Two-frame wide baseline matching , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Eyal Ben-Dor,et al.  Automatic Registration of Airborne and Spaceborne Images by Topology Map Matching with SURF Processor Algorithm , 2011, Remote. Sens..

[9]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Bozidar Potocnik,et al.  A Self-adaptive ASIFT-SH method , 2013, Adv. Eng. Informatics.

[11]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[12]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Qing Zhu,et al.  Propagation strategies for stereo image matching based on the dynamic triangle constraint , 2007 .

[14]  Dmitry Chetverikov,et al.  Affine propagation for surface reconstruction in wide baseline stereo , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[17]  Pierre-Marc Jodoin,et al.  Perspective-SIFT: An efficient tool for low-altitude remote sensing image registration , 2013, Signal Process..

[18]  Mauricio Galo,et al.  Generating Virtual Images from Oblique Frames , 2013, Remote. Sens..

[19]  Alfred Stein,et al.  Transferability of Object-Oriented Image Analysis Methods for Slum Identification , 2013, Remote. Sens..

[20]  K. Wenzel,et al.  A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs , 2013 .

[21]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Miriam Cabrelles,et al.  Automatic orientation and 3D modelling from markerless rock art imagery , 2013 .

[23]  D. Chetverikov,et al.  Surface Normal Aided Dense Reconstruction from Images , 2006 .

[24]  Tieniu Tan,et al.  A Novel Algorithm for View and Illumination Invariant Image Matching , 2012, IEEE Transactions on Image Processing.

[25]  Charles V. Stewart,et al.  Physical Scale Keypoints: Matching and Registration for Combined Intensity/Range Images , 2011, International Journal of Computer Vision.

[26]  Juho Kannala,et al.  Quasi-Dense Wide Baseline Matching Using Match Propagation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.