Automatic and rapid whole-body 3D shape measurement based on multinode 3D sensing and speckle projection.

Automatic and rapid whole-body 3D shape measurement has attracted extensive attention in recent years and been widely used in many fields. Rapid 3D reconstruction, automatic 3D registration, and dedicated system layout are critical factors to enable an excellent 3D measurement system. In this paper, we present an automatic and rapid whole- body 3D measurement system that is based on multinode 3D sensors using speckle projection. A rapid algorithm for searching homologous point pairs is suggested, which takes advantage of the optimized projective rectification and simplified subpixel matching techniques, leading to an improved time efficiency of 3D reconstruction. Meanwhile, a low-cost automatic system with a flexible setup and an improved calibration strategy are proposed, where system parameters of each node sensor can be simultaneously estimated with the assistance of a cubic and a planar target. Furthermore, an automatic range data registration strategy by employing two aided cameras is investigated. Experiment results show that the presented approach can realize automatic whole-body 3D shape measurement with high efficiency and accuracy.

[1]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[2]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[3]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[4]  X. Su,et al.  3D shape from phase errors by using binary fringe with multi-step phase-shift technique , 2015 .

[5]  J. Apolinar Muñoz Rodríguez,et al.  Binocular self-calibration performed via adaptive genetic algorithm based on laser line imaging , 2016 .

[6]  H. Lu,et al.  Deformation measurements by digital image correlation: Implementation of a second-order displacement gradient , 2000 .

[7]  Song Zhang,et al.  Superfast 3D absolute shape measurement using five binary patterns , 2017 .

[8]  Song Zhang.  Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[9]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[10]  Zonghua Zhang,et al.  Full-field 3D shape measurement of specular surfaces by direct phase to depth relationship , 2016, SPIE/COS Photonics Asia.

[11]  李阿蒙 Li Ameng,et al.  A Method for Global Registration of Range Data Combined with Markers , 2009 .

[12]  C. A. García-Isáis,et al.  One shot profilometry using a composite fringe pattern , 2014 .

[13]  M Sjödahl,et al.  Measurement of shape by using projected random patterns and temporal digital speckle photography. , 1999, Applied optics.

[14]  Xiang Peng,et al.  Strategy for automatic and complete three-dimensional optical digitization. , 2012, Optics letters.

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Hao Jiang,et al.  High dynamic range imaging for fringe projection profilometry with single-shot raw data of the color camera , 2017 .

[18]  Xing Wang,et al.  High-accuracy and real-time 3D positioning, tracking system for medical imaging applications based on 3D digital image correlation , 2017 .

[19]  Cheng Teng,et al.  Color fringe projection profilometry using geometric constraints , 2017 .

[20]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[21]  J. Apolinar Muñoz-Rodríguez.  Computer vision of the foot sole based on laser metrology and algorithms of artificial intelligence , 2009 .

[22]  Richard I. Hartley,et al.  Theory and Practice of Projective Rectification , 1999, International Journal of Computer Vision.

[23]  Xiang Peng,et al.  Optical measurement network for large-scale and shell-like objects. , 2011, Optics letters.

[24]  Song Zhang,et al.  High-quality 3D shape measurement using saturated fringe patterns , 2016 .

[25]  J Apolinar Muñoz-Rodríguez.  Shape connection by pattern recognition and laser metrology. , 2008, Applied optics.

[26]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[27]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Hao Jiang,et al.  Calibration of fringe projection profilometry using an inaccurate 2D reference target , 2017 .

[29]  Peter Kinnell,et al.  Autonomous metrology for robot mounted 3D vision systems , 2017 .

[30]  Zeev Zalevsky,et al.  Three-dimensional mapping and range measurement by means of projected speckle patterns. , 2008, Applied optics.

[31]  Cong Liu,et al.  Coaxial projection profilometry based on speckle and fringe projection , 2015 .

[32]  Xiaoli Liu,et al.  Calibration strategy of optical measurement network for large-scale and shell-like objects , 2012 .

[33]  Ravindra S. Goonetilleke,et al.  Foot measurements from three-dimensional scans: A comparison and evaluation of different methods , 2006 .

[34]  Jinhui Huang,et al.  Flexible 3D reconstruction method based on phase-matching in multi-sensor system. , 2016, Optics express.

[35]  Xie Huimin,et al.  Performance of sub-pixel registration algorithms in digital image correlation , 2006 .