Robust Building-Based Registration of Airborne Lidar Data and Optical Imagery on Urban Scenes

The motivation of this paper is to address the problem of registering airborne LiDAR data and optical aerial or satellite imagery acquired from different platforms, at different times, with different points of view and levels of detail. In this paper, we present a robust registration method based on building regions, which are extracted from optical images using mean shift segmentation, and from LiDAR data using a 3D point cloud filtering process. The matching of the extracted building segments is then carried out using Graph Transformation Matching (GTM) which allows to determine a common pattern of relative positions of segment centers. Thanks to this registration, the relative shifts between the data sets are significantly reduced, which enables a subsequent fine registration and a resulting high-quality data fusion.

[1]  E. G. Parmehr,et al.  Automatic registration of optical imagery with 3D LiDAR data using statistical similarity , 2014 .

[2]  Alexandre Boulch,et al.  Processing of Extremely High-Resolution LiDAR and RGB Data: Outcome of the 2015 IEEE GRSS Data Fusion Contest–Part A: 2-D Contest , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, CVPR.

[4]  J. E. Chac'on,et al.  A comparison of bandwidth selectors for mean shift clustering , 2013, 1310.7855.

[5]  Arturo Espinosa-Romero,et al.  A robust Graph Transformation Matching for non-rigid registration , 2009, Image Vis. Comput..

[6]  Roman M. Palenichka,et al.  Automatic Extraction of Control Points for the Registration of Optical Satellite and LiDAR Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Qian Du,et al.  Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  S. Ghosh,et al.  Automatic building footprint extraction from high-resolution satellite image using mathematical morphology , 2018 .

[10]  Julien Perret,et al.  A scalable and multi-purpose point cloud server (PCS) for easier and faster point cloud data management and processing , 2017 .

[11]  Gabriele Moser,et al.  Processing of Extremely High Resolution LiDAR and RGB Data: Outcome of the 2015 IEEE GRSS Data Fusion Contest—Part B: 3-D Contest , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  C. Fraser,et al.  Automatic extraction of building roofs using LIDAR data and multispectral imagery , 2013 .

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .