A Review of Optical Imagery and Airborne LiDAR Data RegistrationMethods

Representing a scene completely from remote sensing data requires both spectral and 3-D-surface information. Integration of spectral information from optical images and 3-D-surface information from LiDAR is important in a number of remote sensing applications such as feature extraction, image classification, image analysis, building extraction, 3-D city modelling, canopy modelling etc. Therefore, numerous methods have been developed in the last decade to align both data sets into a common reference frame to effectively utilize their complementary characteristics. However, due to the significantly different characteristics between optical image and LiDAR data, there are a number of technical challenges in the alignment of both data sets. Different research papers introduced different strategy or methodology to overcome the challenges, reaching different alignment/registration results. This paper presents a review of classical and up to date optical-LiDAR registration methods with the emphasis on control point detection and matching. The aim of this paper is to provide readers with an overview of existing methods, identify their advantages and limitations, and give readers the overall information on what will be useful for researchers and practitioners to realistically select proper method for their application.

[1]  Nicu Sebe,et al.  Comparing salient point detectors , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[2]  Simon D. Jones,et al.  AUTOMATIC CLASSIFICATION OF LAND COVER FEATURES WITH HIGH RESOLUTION IMAGERY AND LIDAR DATA: AN OBJECT-ORIENTED APPROACH , 2005 .

[3]  C. Brenner Building reconstruction from images and laser scanning , 2005 .

[4]  A. Krupnik,et al.  REGISTRATION OF AIRBORNE LASER DATA TO SURFACES GENERATED BY PHOTOGRAMMETRIC MEANS , 2004 .

[5]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  Takis Kasparis,et al.  Autonomous Registration of LiDAR Data to Single Aerial Image , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Hemant D. Tagare,et al.  A Maximum-Likelihood Strategy for Directing Attention during Visual Search , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[9]  Roman M. Palenichka,et al.  Automatic Extraction of Control Points for the Registration of Optical Satellite and LiDAR Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[11]  Han Wang,et al.  Analysis of gray level corner detection , 1999, Pattern Recognit. Lett..

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[13]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[14]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Emmanuel P. Baltsavias,et al.  A comparison between photogrammetry and laser scanning , 1999 .

[16]  Alexander Wong,et al.  Efficient FFT-Accelerated Approach to Invariant Optical–LIDAR Registration , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[18]  T. Schenk FUSION OF LIDAR DATA AND AERIAL IMAGERY FOR A MORE COMPLETE SURFACE DESCRIPTION , 2002 .

[19]  Tang Ping,et al.  Study on Object-oriented Classification Method by Integrating Various Features , 2006 .

[20]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[21]  A. F. Habib,et al.  INTEGRATION OF LASER AND PHOTOGRAMMETRIC DATA FOR CALIBRATION PURPOSES , 2004 .

[22]  Franz Rottensteiner,et al.  AUTOMATIC EXTRACTION OF BUILDINGS FROM LIDAR DATA AND AERIAL IMAGES , 2002 .

[23]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, CVPR.

[24]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[25]  Jacqueline Le Moigne,et al.  Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery , 2005, IEEE Transactions on Image Processing.

[26]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[27]  Yun Zhang,et al.  A critical review of image registration methods , 2010 .

[28]  Ayman Habib,et al.  A NEW APPROACH FOR MATCHING SURFACES FROM LASER SCANNERS AND OPTICAL SCANNERS , 2000 .

[29]  Deng Fei,et al.  AUTOMATIC REGISTRATION BETWEEN LIDAR AND DIGITAL IMAGES , 2008 .

[30]  Jianya Gong,et al.  A Two-step Displacement Correction Algorithm for Registration of Lidar Point Clouds and Aerial Images without Orientation Parameters , 2010 .

[31]  Liang-Chien Chen,et al.  Fusion of LIDAR data and high resolution images for forest canopy modeling , 2005 .

[32]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[33]  Kiyun Yu,et al.  Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information , 2006 .

[34]  Yongjun Zhang,et al.  Photogrammetric Modeling of Linear Features with Generalized Point Photogrammetry , 2007 .

[35]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[36]  Roman M. Palenichka,et al.  Object Shape Extraction Based on the Piecewise Linear Skeletal Representation , 2005, ICIAR.

[37]  Ayman F. Habib,et al.  Integration of Photogrammetric and LIDAR Data in a Multi-Primitive Triangulation Environment , 2006, 3D-GIS.

[38]  Mohamed S. Kamel,et al.  Virtual circles: a new set of features for fast image registration , 2003, Pattern Recognit. Lett..