Three-dimensional Scan Registration using Curvelet Features in Planetary Environments

Topographic mapping in planetary environments relies on accurate three-dimensional 3D scan registration methods. However, most global registration algorithms relying on features such as fast point feature histograms and Harris-3D show poor alignment accuracy in these settings due to the poor structure of the Mars-like terrain, and the variable-resolution, occluded, sparse range data that are difficult to register without some a priori knowledge of the environment. In this paper, we propose an alternative approach to 3D scan registration using the curvelet transform that performs multiresolution geometric analysis to obtain a set of coefficients indexed by scale coarsest to finest, angle, and spatial position. Features are detected in the curvelet domain to take advantage of the directional selectivity of the transform. A descriptor is computed for each feature by calculating the 3D spatial histogram of the image gradients, and nearest-neighbor-based matching is used to calculate the feature correspondences. Correspondence rejection using random sample consensus identifies inliers, and a locally optimal singular value decomposition-based estimation of the rigid-body transformation aligns the laser scans given the reprojected correspondences in the metric space. Experimental results on a publicly available dataset of a planetary analogue indoor facility, as well as simulated and real-world scans from Neptec Design Group's IVIGMS 3D laser rangefinder at the outdoor CSA Mars yard, demonstrate improved performance over existing methods in the challenging sparse Mars-like terrain.

[1]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[2]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Michael Bosse,et al.  Zebedee: Design of a Spring-Mounted 3-D Range Sensor with Application to Mobile Mapping , 2012, IEEE Transactions on Robotics.

[5]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[7]  Minh N. Do,et al.  Multidimensional Directional Filter Banks and Surfacelets , 2007, IEEE Transactions on Image Processing.

[8]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[9]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .

[12]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Arun Das,et al.  3D scan registration using the Normal Distributions Transform with ground segmentation and point cloud clustering , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[15]  Gilles Burel,et al.  Three-dimensional invariants and their application to object recognition , 1995, Signal Process..

[16]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[17]  Marc Alexa,et al.  On Normals and Projection Operators for Surfaces Defined by Point Sets , 2004, PBG.

[18]  Tim D. Barfoot,et al.  A self-calibrating 3D ground-truth localization system using retroreflective landmarks , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Wolfram Burgard,et al.  Robust on-line model-based object detection from range images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Benjamin Bustos,et al.  A Robust 3D Interest Points Detector Based on Harris Operator , 2010, 3DOR@Eurographics.

[21]  Babak Taati,et al.  Difference of Normals as a Multi-scale Operator in Unorganized Point Clouds , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[22]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[23]  Steven Lake Waslander,et al.  Scan registration with multi-scale k-means normal distributions transform , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  H. Tucker A Generalization of the Glivenko-Cantelli Theorem , 1959 .

[25]  Luca Iocchi,et al.  Scan Matching in the Hough Domain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[26]  Katsuhiko Sakaue,et al.  Registration and integration of multiple range images for 3-D model construction , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[27]  Bo Wu,et al.  Co-registration of lunar topographic models derived from Chang’E-1, SELENE, and LRO laser altimeter data based on a novel surface matchingmethod , 2013 .

[28]  Wolfram Burgard,et al.  Point feature extraction on 3D range scans taking into account object boundaries , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[32]  Kostas Daniilidis,et al.  Fully Automatic Registration of 3D Point Clouds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[34]  Xiaoming Huo,et al.  Beamlets and Multiscale Image Analysis , 2002 .

[35]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  S. M. Mahbubur Rahman,et al.  Entropy-based image registration method using the curvelet transform , 2014, Signal Image Video Process..

[37]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[38]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[39]  Tim D. Barfoot,et al.  The Canadian planetary emulation terrain 3D mapping dataset , 2013, Int. J. Robotics Res..

[40]  Joachim Hertzberg,et al.  Evaluation of 3D registration reliability and speed - A comparison of ICP and NDT , 2009, 2009 IEEE International Conference on Robotics and Automation.

[41]  Rupesh Shrestha,et al.  A Slope-based Method for Matching Elevation Surfaces , 2011 .

[42]  Tim D. Barfoot,et al.  3D SLAM for planetary worksite mapping , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Ray Jarvis,et al.  3D free-form surface registration and object recognition , 2004, International Journal of Computer Vision.

[44]  Stefano Carpin,et al.  HSM3D: Feature-less global 6DOF scan-matching in the Hough/Radon domain , 2009, 2009 IEEE International Conference on Robotics and Automation.

[45]  D. Donoho Wedgelets: nearly minimax estimation of edges , 1999 .

[46]  Ernest L. Hall,et al.  Three-Dimensional Moment Invariants , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Timothy D. Barfoot,et al.  Long-range rover localization by matching LIDAR scans to orbital elevation maps , 2010 .

[48]  Andrew E. Johnson,et al.  Recognizing objects by matching oriented points , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[51]  Y. Keller,et al.  Volume Registration Using the 3-D Pseudopolar Fourier Transform , 2006, IEEE Transactions on Signal Processing.

[52]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[53]  Giorgio Grisetti,et al.  Robust optimization of factor graphs by using condensed measurements , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Siddhant Ahuja,et al.  Scan registration using Region-growing clustering NDT , 2014 .

[55]  Marc Rioux,et al.  Three-dimensional registration using range and intensity information , 1994, Other Conferences.

[56]  Chitra Dorai,et al.  Optimal Registration of Object Views Using Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[58]  Steven Lake Waslander,et al.  3D Scan Registration Using Curvelet Features , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[59]  Andreas Birk,et al.  Spectral 6DOF Registration of Noisy 3D Range Data with Partial Overlap , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[61]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..