Self-registration shape measurement based on fringe projection and structure from motion.

As an accurate and efficient shape measurement method, fringe-projection-based three-dimensional (3D) reconstruction has been extensively studied. However, patchwise point cloud registration without extra assistance is still a challenging task. We present a flexible and robust self-registration shape measurement method based on fringe projection and structure from motion (SfM). Other than ordinary structured-light measurement devices in which the camera and the projector are rigidly connected together, the camera and the projector in our method can be moved independently. An image-capturing scheme and underlying image-matching strategy are proposed. By selectively utilizing some sparse correspondence points across the fringe images as virtual markers, the global positions of the camera and the projector corresponding to each image are calculated and optimized under the framework of SfM. Dense global 3D points all over the object surface are finally calculated via forward intersection. Experimental results on different objects demonstrate that the proposed method can obtain a self-registered 3D point cloud with comparable accuracy to the state-of-the-art techniques by using only one camera and one projector, requiring no post-registration procedures and no assistant markers.

[1]  Changyan Xiao,et al.  Complete grid pattern decoding method for a one-shot structured light system. , 2020, Applied optics.

[2]  Song Zhang,et al.  High-speed high-accuracy three-dimensional shape measurement using digital binary defocusing method versus sinusoidal method , 2017 .

[3]  Geraldine S. Cheok,et al.  Fast automatic registration of range images from 3D imaging systems using sphere targets , 2009 .

[4]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[5]  A. Bab-Hadiashar,et al.  An Overview to Visual Odometry and Visual SLAM: Applications to Mobile Robotics , 2015 .

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[9]  Mario Sokac,et al.  Evaluation of synthetically generated patterns for image-based 3D reconstruction of texture-less objects , 2019 .

[10]  Beiwen Li,et al.  Single-shot absolute 3D shape measurement with Fourier transform profilometry. , 2016, Applied optics.

[11]  Jiangtao Xi,et al.  Accurate projector calibration based on a new point-to-point mapping relationship between the camera and projector images , 2015 .

[12]  Song Zhang,et al.  Superfast multifrequency phase-shifting technique with optimal pulse width modulation. , 2011, Optics express.

[13]  Xuyong Li,et al.  A high-accuracy method for fine registration of overlapping point clouds , 2010, Image Vis. Comput..

[14]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[15]  B. Breuckmann,et al.  Computer-aided analysis of holographic interferograms using the phase-shift method. , 1985, Applied optics.

[16]  Reinhold Ritter,et al.  3-D shape measurement of complex objects by combining photogrammetry and fringe projection , 2000 .

[17]  Dongsheng Zhang,et al.  Health monitoring of wind turbine blades in operation using three-dimensional digital image correlation , 2019, Mechanical Systems and Signal Processing.

[18]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[19]  Yanxue Wu,et al.  High-resolution few-pattern method for 3D optical measurement. , 2019, Optics letters.

[20]  Ken Chen,et al.  A self-recalibration method based on scale-invariant registration for structured light measurement systems , 2017 .

[21]  Daniel G. Aliaga,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 a Self-calibrating Method for Photogeometric Acquisition of 3d Objects , 2022 .

[22]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[23]  Tzung-Han Lin,et al.  Automatic 3D color shape measurement system based on a stereo camera. , 2020, Applied optics.

[24]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[25]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Francisco José Madrid-Cuevas,et al.  Simultaneous reconstruction and calibration for multi-view structured light scanning , 2016, J. Vis. Commun. Image Represent..