Three-dimensional point cloud alignment detecting fiducial markers by structured light stereo imaging

In recent years, various methodologies of shape reconstruction have been proposed with the aim at creating Computer-Aided Design models by digitising physical objects using optical sensors. Generally, the acquisition of 3D geometrical data includes crucial tasks, such as planning scanning strategies and aligning different point clouds by multiple view approaches, which differ for user’s interaction and hardware cost. This paper describes a methodology to automatically measure three-dimensional coordinates of fiducial markers to be used as references to align point clouds obtained by an active stereo vision system based on structured light projection. Intensity-based algorithms and stereo vision principles are combined to detect passive fiducial markers localised in a scene. 3D markers are uniquely recognised on the basis of geometrical similarities. The correlation between fiducial markers and point clouds allows the digital creation of complete object surfaces. The technology has been validated by experimental tests based on nominal benchmarks and reconstructions of target objects with complex shapes.

[1]  Ralph R. Martin,et al.  Reverse engineering of geometric models - an introduction , 1997, Comput. Aided Des..

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  H. K. Abhyankar,et al.  Image Registration Techniques: An overview , 2009 .

[4]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[5]  L.M. Galantucci,et al.  Coded targets and hybrid grids for photogrammetric 3D digitisation of human faces , 2008 .

[6]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[7]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[8]  Paolo Cignoni,et al.  Exploiting the scanning sequence for automatic registration of large sets of range maps , 2005, Comput. Graph. Forum.

[9]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[10]  Malik Mallem,et al.  A Robust Circular Fiducial Detection Technique and Real-Time 3D Camera Tracking , 2008, J. Multim..

[11]  Reinhard Klette,et al.  Surface Registration Markers from Range Scan Data , 2006, IWCIA.

[12]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[13]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[14]  Fan Xiao,et al.  What is the best fiducial? , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[15]  Naokazu Yokoya,et al.  Localization of wearable users using invisible retro-reflective markers and an IR camera , 2005, IS&T/SPIE Electronic Imaging.

[16]  Paolo Cignoni,et al.  RoboScan: an automatic system for accurate and unattended 3D scanning , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[17]  F. Crosilla,et al.  AUTOMATIC MORPHOLOGICAL PRE-ALIGNMENT AND GLOBAL HYBRID REGISTRATION OF CLOSE RANGE IMAGES , 2006 .

[18]  Giovanna Sansoni,et al.  Noncontact 3D sensing of free-form complex surfaces , 2000, IS&T/SPIE Electronic Imaging.

[19]  Sandro Barone,et al.  A REVERSE ENGINEERING METHODOLOGY TO CAPTURE COMPLEX SHAPES , 2004 .

[20]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[21]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[23]  Chang Shu,et al.  Self-identifying patterns for plane-based camera calibration , 2008, Machine Vision and Applications.

[24]  Michael A. Sutton,et al.  Three-dimensional point cloud registration by matching surface features with relaxation labeling method , 2005 .

[25]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .

[26]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[27]  Mark Fiala,et al.  Designing Highly Reliable Fiducial Markers , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[29]  Andrew W. Fitzgibbon,et al.  Reliable Fiducial Detection in Natural Scenes , 2004, ECCV.

[30]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[31]  John N. Butters.  Optical measuring techniques , 1974, Nature.

[32]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[33]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[34]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.