Keypoint-based 4-Points Congruent Sets – Automated marker-less registration of laser scans

Abstract We propose a method to automatically register two point clouds acquired with a terrestrial laser scanner without placing any markers in the scene. What makes this task challenging are the strongly varying point densities caused by the line-of-sight measurement principle, and the huge amount of data. The first property leads to low point densities in potential overlap areas with scans taken from different viewpoints while the latter calls for highly efficient methods in terms of runtime and memory requirements. A crucial yet largely unsolved step is the initial coarse alignment of two scans without any simplifying assumptions, that is, point clouds are given in arbitrary local coordinates and no knowledge about their relative orientation is available. Once coarse alignment has been solved, scans can easily be fine-registered with standard methods like least-squares surface or Iterative Closest Point matching. In order to drastically thin out the original point clouds while retaining characteristic features, we resort to extracting 3D keypoints. Such clouds of keypoints, which can be viewed as a sparse but nevertheless discriminative representation of the original scans, are then used as input to a very efficient matching method originally developed in computer graphics, called 4-Points Congruent Sets (4PCS) algorithm. We adapt the 4PCS matching approach to better suit the characteristics of laser scans. The resulting Keypoint-based 4-Points Congruent Sets (K-4PCS) method is extensively evaluated on challenging indoor and outdoor scans. Beyond the evaluation on real terrestrial laser scans, we also perform experiments with simulated indoor scenes, paying particular attention to the sensitivity of the approach with respect to highly symmetric scenes.

[1]  Konrad Schindler,et al.  Approximate registration of point clouds with large scale differences , 2013 .

[2]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  J. Paul Siebert,et al.  Local feature extraction and matching on range images: 2.5D SIFT , 2009, Comput. Vis. Image Underst..

[4]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Marc Pollefeys,et al.  Automatic Registration of RGB-D Scans via Salient Directions , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Sisi Zlatanova,et al.  Automatic Registration of Terrestrial Laser Scanning Point Clouds using Panoramic Reflectance Images , 2009, Sensors.

[7]  Konrad Schindler,et al.  AUTOMATIC REGISTRATION OF TERRESTRIAL LASER SCANNER POINT CLOUDS USING NATURAL PLANAR SURFACES , 2012 .

[8]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[9]  Daniel P. Huttenlocher,et al.  Fast affine point matching: an output-sensitive method , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Najla Megherbi Bouallagu,et al.  Object Recognition using 3D SIFT in Complex CT Volumes , 2010, BMVC.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[15]  Claus Brenner,et al.  Coarse orientation of terrestrial laser scans in urban environments , 2008 .

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Shi-Min Hu,et al.  Geometry and Convergence Analysis of Algorithms for Registration of 3D Shapes , 2006, International Journal of Computer Vision.

[19]  C. Brenner,et al.  AUTOMATIC RELATIVE ORIENTATION OF TERRESTRIAL LASER SCANS USING PLANAR STRUCTURES AND ANGLE CONSTRAINTS , 2007 .

[20]  Susanne Becker,et al.  Automatic Marker-Free Registration of Terrestrial Laser Scans using Reflectance Features , 2007 .

[21]  Anton van den Hengel,et al.  Thrift: Local 3D Structure Recognition , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[22]  Jiaolong Yang,et al.  Go-ICP: Solving 3D Registration Efficiently and Globally Optimally , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Kwang-Ho Bae Automated Registration of Unorganised Point Clouds from Terrestrial Laser Scanners , 2004 .

[24]  Geraldine S. Cheok,et al.  Fast automatic registration of range images from 3D imaging systems using sphere targets , 2009 .

[25]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[26]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[27]  Konrad Schindler,et al.  Markerless point cloud registration with keypoint-based 4-points congruent sets , 2013 .

[28]  Sandy Irani,et al.  Combinatorial and experimental results for randomized point matching algorithms , 1996, SCG '96.

[29]  M. Devrim Mehmet Devrim Akça FULL AUTOMATIC REGISTRATION OF LASER SCANNER POINT CLOUDS , 2003 .

[30]  Kwang-Ho Bae,et al.  Evaluation of the Convergence Region of an Automated Registration Method for 3D Laser Scanner Point Clouds , 2009, Sensors.

[31]  Florent Lamiraux,et al.  Metric-based iterative closest point scan matching for sensor displacement estimation , 2006, IEEE Transactions on Robotics.

[32]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[33]  Vladimir Pekar,et al.  Full orientation invariance and improved feature selectivity of 3D SIFT with application to medical image analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.