Matching of straight line segments from aerial stereo images of urban areas

Reliable extraction of corresponding straight lines in overlapping images can be used for different purposes such as 3D object extraction, image registration, automated triangulation, etc. In this study, a new approach for the matching of straight line features from stereo aerial images is presented. Initial correspondences between stereo images are generated using a pair-wise stereo matching approach, which involves a total of seven relational constraints. The final straight line correspondences between the stereo images are established in a line-to-line matching stage. The optimal settings for the parameters guiding the matching phase are determined after analysing the probability density functions (PDFs). The proposed approach is tested on 30 image patches of two different urban areas, and as a result, very successful and promising stereo line matching performances are achieved. Besides, the comparison of the results of the proposed approach with the results of one of the state-of-the-art stereo matching approaches proves the superiority and potential of the proposed approach.

[1]  George Vosselman,et al.  Reconstruction of 3D building models from aerial images and maps , 2003 .

[2]  Chunsun Zhang,et al.  Edge matching and 3D road reconstruction using knowledge-based methods , 2000 .

[3]  Marc Pierrot Deseilligny,et al.  Extraction of 3D Primitives from Stereopairs of Satellite Images for Automatic Reconstruction of Buildings , 2002, MVA.

[4]  Michel Roux,et al.  Feature matching for building extraction from multiple views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[6]  Cordelia Schmid,et al.  AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS , 1999 .

[7]  J. D. Wegner,et al.  A NEW STRAIGHT LINE RECONSTRUCTION METHODOLOGY FROM MULTI-SPECTRAL STEREO AERIAL IMAGES , 2010 .

[8]  Alan F. Smeaton,et al.  An Improved Spatiogram Similarity Measure for Robust Object Localisation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  Jean Pierre Cocquerez,et al.  Three-dimensional description of scenes observed in aerial photography , 1995, Pattern Recognit..

[10]  C Baillard,et al.  A STEREO MATCHING ALGORITHM FOR URBAN DIGITAL ELEVATION MODELS , 2000 .

[11]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Raymond K. K. Yip,et al.  Multi-level based stereo line matching with structural information using dynamic programming , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[14]  Michael Cramer,et al.  The DGPF-Test on Digital Airborne Camera Evaluation - Over- view and Test Design , 2010 .

[15]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Wolfgang Förstner,et al.  Matching, reconstructing and grouping 3D lines from multiple views using uncertain projective geometry , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Ramakant Nevatia,et al.  Detection and Modeling of Buildings from Multiple Aerial Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Luc Van Gool,et al.  Automatic Modeling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery , 1998, ECCV.

[19]  George Vosselman,et al.  AUTOMATIC DETECTION OF BUILDINGS WITH RECTANGULAR FLAT ROOFS FROM MULTI-VIEW OBLIQUE IMAGERY , 2010 .

[20]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[21]  Christian Beder.  A UNIFIED FRAMEWORK FOR THE AUTOMATIC MATCHING OF POINTS AND LINES IN MULTIPLE ORIENTED IMAGES , 2004 .

[22]  Volkan Atalay,et al.  A matching algorithm based on linear features , 1998, Pattern Recognit. Lett..

[23]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[24]  Allen R. Hanson,et al.  Three-Dimensional Reconstruction of Points and Lines with Unknown Correspondence across Images , 2005, International Journal of Computer Vision.

[25]  Li Zhang.  Automatic Digital Surface Model (DSM) generation from linear array images , 2005 .

[26]  Nicolas Paparoditis,et al.  EXTRACTING 3D FREE-FORM SURFACE BOUNDARIES OF MAN-MADE OBJECTS FROM MULTIPLE CALIBRATED IMAGES: A ROBUST, ACCURATE AND HIGH RESOLVING POWER EDGEL MATCHING AND CHAINING APPROACH , 2003 .

[27]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[28]  Jan Dirk Wegner,et al.  A stereo line matching technique for aerial images based on a pair-wise relation approach , 2010 .

[29]  Uwe Stilla,et al.  Semantic Modelling of Man-Made Objects by Production Nets , 1997 .

[30]  Ramakant Nevatia,et al.  Stereo Error Detection, Correction, and Evaluation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  E. Baltsavias,et al.  Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) , 1995 .

[32]  Joost van de Weijer,et al.  Robust photometric invariant features from the color tensor , 2006, IEEE Transactions on Image Processing.

[33]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Yoshiki Nakamura,et al.  International commission on illumination , 1928, Journal of the A.I.E.E..

[35]  Changjae Kim,et al.  Generation of Complex Polyhedral Building Models by Integrating Stereo-Aerial Imagery and Lidar Data , 2010 .

[36]  Sang Uk Lee,et al.  A Line Feature Matching Technique Based on an Eigenvector Approach , 2000, Comput. Vis. Image Underst..

[37]  Olof Henricsson,et al.  The Role of Color Attributes and Similarity Grouping in 3-D Building Reconstruction , 1998, Comput. Vis. Image Underst..

[38]  Ahmed F. Elaksher,et al.  ROOF BOUNDARY EXTRACTION USING MULTIPLE IMAGES , 2003 .

[39]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.