Transformation Model with Constraints for High-Accuracy of 2D-3D Building Registration in Aerial Imagery

This paper proposes a novel rigorous transformation model for 2D-3D registration to address the difficult problem of obtaining a sufficient number of well-distributed ground control points (GCPs) in urban areas with tall buildings. The proposed model applies two types of geometric constraints, co-planarity and perpendicularity, to the conventional photogrammetric collinearity model. Both types of geometric information are directly obtained from geometric building structures, with which the geometric constraints are automatically created and combined into the conventional transformation model. A test field located in downtown Denver, Colorado, is used to evaluate the accuracy and reliability of the proposed method. The comparison analysis of the accuracy achieved by the proposed method and the conventional method is conducted. Experimental results demonstrated that: (1) the theoretical accuracy of the solved registration parameters can reach 0.47 pixels, whereas the other methods reach only 1.23 and 1.09 pixels; (2) the RMS values of 2D-3D registration achieved by the proposed model are only two pixels along the x and y directions, much smaller than the RMS values of the conventional model, which are approximately 10 pixels along the x and y directions. These results demonstrate that the proposed method is able to significantly improve the accuracy of 2D-3D registration with much fewer GCPs in urban areas with tall buildings.

[1]  Max A. Viergever,et al.  3D multimodality medical image registration using morphological tools , 2001, Image Vis. Comput..

[2]  Kidiyo Kpalma,et al.  Automatic registration of ERS and SPOT multisensor images in a data fusion context , 2000 .

[3]  John K. Pollard,et al.  Accurate geometric correction of ATSR images , 1997, IEEE Trans. Geosci. Remote. Sens..

[4]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[5]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[6]  Murray H. Loew,et al.  Fully automatic 3D feature-based registration of multi-modality medical images , 2001, Image Vis. Comput..

[7]  Gabor Fichtinger,et al.  Monitoring tumor motion by real time 2D/3D registration during radiotherapy , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[8]  Baozong Yuan,et al.  CCD camera calibration based on natural landmarks , 1998, Pattern Recognit..

[9]  Jan Flusser,et al.  3D Rigid registration by cylindrical phase correlation method , 2009, Pattern Recognit. Lett..

[10]  A. Ardeshir Goshtasby,et al.  Volume image registration by template matching , 2001, Image Vis. Comput..

[11]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Daniel Rueckert,et al.  Using Photo-Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Mario A. Gomarasca,et al.  Elements of Photogrammetry , 2009 .

[14]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[15]  Weirong Chen,et al.  A comprehensive study on urban true orthorectification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  A. Habib,et al.  Bundle Adjustment with Self–Calibration Using Straight Lines , 2002 .

[17]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[18]  Nassir Navab,et al.  Linear intensity-based image registration by Markov random fields and discrete optimization , 2010, Medical Image Anal..

[19]  Yongjun Zhang,et al.  Automatic registration between images and laser range data , 2005, International Symposium on Multispectral Image Processing and Pattern Recognition.

[20]  Oscar Cordón,et al.  A comparative study of state-of-the-art evolutionary image registration methods for 3D modeling , 2011, Comput. Vis. Image Underst..

[21]  Max Mignotte,et al.  3D/2D registration and segmentation of scoliotic vertebrae using statistical models. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[22]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[23]  Suya You,et al.  Photorealistic Large-Scale Urban City Model Reconstruction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Oscar Cordón,et al.  Feature-based image registration by means of the CHC evolutionary algorithm , 2006, Image Vis. Comput..

[25]  Radu Horaud,et al.  New Methods for Matching 3-D Objects with Single Perspective Views , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[27]  Ioannis Stamos,et al.  A systematic approach for 2D-image to 3D-range registration in urban environments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  C. Song,et al.  Urban 3D GIS From LiDAR and digital aerial images , 2004, Comput. Geosci..

[29]  Guang-Zhong Yang,et al.  Extraction of visual features with eye tracking for saliency driven 2D/3D registration , 2005, Image Vis. Comput..

[30]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Guoqing Zhou,et al.  Orthoimage Creation of Extremely High Buildings , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Andrew W. Fitzgibbon,et al.  Robust Registration of 2D and 3D Point Sets , 2003, BMVC.

[33]  Rune Solberg,et al.  A model-based approach for geometrical correction of optical satellite images , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[34]  Christian Früh,et al.  An Automated Method for Large-Scale, Ground-Based City Model Acquisition , 2004, International Journal of Computer Vision.

[35]  Guoqing Zhou,et al.  Geo-Referencing of Video Flow From Small Low-Cost Civilian UAV , 2010, IEEE Transactions on Automation Science and Engineering.

[36]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.