Multi-feature combination method for point cloud intensity feature image and UAV optical image matching

LiDAR point clouds and optical images are two widely used geospatial data. The fusion of LiDAR point clouds and optical images can take full advantage of these two types of data. Since LiDAR point clouds and optical images vary in dimension (3D vs. 2D), spectral (near-infrared vs. visible) and data acquisition principles ( time of flight vs. perspective projection), the fusion of LiDAR point clouds and optical images is challenging. This paper deals with the registration of LiDAR point clouds and optical images. Feature point-based matching methods with different feature detector and descriptor combinations are evaluated, and find that different combinations affect the matching performance greatly. Among the evaluated 112 combinations, FAST-SIFT and AGAST-SIFT combinations have the best matching performance. Besides, to remove the large amount mismatches in the matching results, the paper proposed a template and RANSAC based mismatch removal algorithm. The experimental results show that the proposed mismatch removal algorithm greatly improved the matching success rate and the correct matching rate.

[1]  Li Jianping,et al.  Automatic Registration of Vehicle-borne Mobile Mapping Laser Point Cloud and Sequent Panoramas , 2018 .

[2]  G. Vosselman,et al.  AUTOMATIC FEATURE DETECTION, DESCRIPTION AND MATCHING FROM MOBILE LASER SCANNING DATA AND AERIAL IMAGERY , 2016 .

[3]  G. Vosselman,et al.  LOW-LEVEL TIE FEATURE EXTRACTION OF MOBILE MAPPING DATA (MLS/IMAGES) AND AERIAL IMAGERY , 2016 .

[4]  Vincent Lepetit,et al.  Learning Image Descriptors with Boosting , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Maoteng Zheng,et al.  LiDAR Strip Adjustment Using Multifeatures Matched With Aerial Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Tal Hassner,et al.  LATCH: Learned arrangements of three patch codes , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Federico Tombari,et al.  Interest Points via Maximal Self-Dissimilarities , 2014, ACCV.

[8]  Andrew Zisserman,et al.  Learning Local Feature Descriptors Using Convex Optimisation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[10]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[12]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[13]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[14]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[15]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[17]  David Nistér,et al.  Linear Time Maximally Stable Extremal Regions , 2008, ECCV.

[18]  Ioannis Stamos,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008, International Journal of Computer Vision.

[19]  Avideh Zakhor,et al.  Automatic registration of aerial imagery with untextured 3D LiDAR models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[21]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[22]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[23]  C. Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[24]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[25]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Nie Qia,et al.  Registration of Vehicle-borne Laser Point Clouds and Panoramic Images , 2014 .

[27]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[28]  Wu Jianwei,et al.  Registration of LiDAR Point Clouds and High Resolution Images Based on Linear Features , 2012 .

[29]  M. Roux,et al.  REGISTRATION OF AIRBORNE LASER DATA WITH ONE AERIAL IMAGE , 2012 .

[30]  C. Toth,et al.  EVALUATION OF MULTIPLE-DOMAIN IMAGERY MATCHING BASED ON DIFFERENT FEATURE SPACES , 2011 .

[31]  C. Armenakis,et al.  CO-REGISTRATION OF LIDAR AND PHOTOGRAMMETRIC DATA FOR UPDATING BUILDING DATABASES , 2010 .

[32]  Christopher Hunt.  SURF: Speeded-Up Robust Features , 2009 .

[33]  Abbas Abedinia,et al.  AN INVESTIGATION INTO THE REGISTRATION OF LIDAR INTENSITY DATA AND AERIAL IMAGES USING THE SIFT APPROACH , 2008 .

[34]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.