3-D Reconstruction Method for a Multiview System Based on Global Consistency

Structured light-based micro 3-D imaging technology is widely used in industrial applications. Using a well-calibrated camera and a projector, it is easy to obtain 3-D surface topography of objects. However, single camera–projector pair suffers from problems caused by shadows, and their accuracy is limited due to the restricted field of view (FoV). To overcome these issues, this article proposes a multiprojector vision system consisting of a central camera and four surrounding projectors. The global geometry constraint scheme is applied to ensure consistency and stability across multiple projectors, which is achieved by board-to-board pose optimization. In addition, instead of directly using the iso-phase fringe line, geometric plane constraints are used in the calibration process to estimate corresponding projector pixel coordinates. Finally, a triangulation-based 3-D reconstruction and data fusion approach is proposed to obtain high precision and shadow-reduced 3-D surface topography. Experimental results are presented and discussed that demonstrate the good consistency and measurement accuracy of the proposed approach. The global geometry constraint scheme allows relative standard deviation (RSD) and root-mean-square error (RMSE) in the measurements to be significantly reduced.

[1]  Jianbin Qiu,et al.  Trajectory Tracking of Variable Centroid Objects Based on Fusion of Vision and Force Perception. , 2023, IEEE transactions on cybernetics.

[2]  Huijun Gao,et al.  Master-Slave Synchronous Control of Dual-Drive Gantry Stage With Cogging Force Compensation , 2023, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Zonghua Zhang,et al.  High-Accuracy Calibration of High-Speed Fringe Projection Profilometry Using a Checkerboard , 2022, IEEE/ASME Transactions on Mechatronics.

[4]  François Rameau,et al.  MC-Calib: A generic and robust calibration toolbox for multi-camera systems , 2022, Comput. Vis. Image Underst..

[5]  M. Pollefeys,et al.  Orthographic-Perspective Epipolar Geometry , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Yan Hu,et al.  Calibration of fringe projection profilometry: A comparative review , 2021 .

[7]  Daniel L. Lau,et al.  Sparse Multi-Path Corrections in Fringe Projection Profilometry , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Huijun Gao,et al.  Hierarchical Multiobjective Heuristic for PCB Assembly Optimization in a Beam-Head Surface Mounter , 2021, IEEE Transactions on Cybernetics.

[9]  Zhao Song,et al.  Micrometer-level 3D measurement techniques in complex scenes based on stripe-structured light and photometric stereo. , 2020, Optics express.

[10]  Shijie Feng,et al.  Microscopic fringe projection profilometry: A review , 2020 .

[11]  Andrés G. Marrugo,et al.  What is the best triangulation approach for a structured light system? , 2020, Defense + Commercial Sensing.

[12]  Daniel L. Lau,et al.  Dual-projector structured light 3D shape measurement. , 2020, Applied optics.

[13]  David Lentink,et al.  Automated calibration of multi-camera-projector structured light systems for volumetric high-speed 3D surface reconstructions. , 2018, Optics express.

[14]  Ken Chen,et al.  Normal Direction Measurement and Optimization With a Dense Three-Dimensional Point Cloud in Robotic Drilling , 2018, IEEE/ASME Transactions on Mechatronics.

[15]  Song Zhang,et al.  Three-dimensional shape measurement using a structured light system with dual projectors. , 2018, Applied optics.

[16]  Hendrik P. A. Lensch,et al.  Multi-view Continuous Structured Light Scanning , 2017, GCPR.

[17]  Yi Ma,et al.  A new calibration technique for multi-camera systems of limited overlapping field-of-views , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Meng Wang,et al.  Improved performance of multi-view fringe projection 3D microscopy. , 2017, Optics express.

[19]  J. Morel,et al.  A Precision Analysis of Camera Distortion Models , 2017, IEEE Transactions on Image Processing.

[20]  Carsten Steger,et al.  A Comprehensive and Versatile Camera Model for Cameras with Tilt Lenses , 2017, International Journal of Computer Vision.

[21]  Dongliang Zheng,et al.  Phase-shifting profilometry combined with Gray-code patterns projection: unwrapping error removal by an adaptive median filter. , 2017, Optics express.

[22]  Heming Huang,et al.  Flexible calibration method for telecentric fringe projection profilometry systems. , 2016, Optics express.

[23]  In-So Kweon,et al.  A Multi-view Structured-Light System for Highly Accurate 3D Modeling , 2015, 2015 International Conference on 3D Vision.

[24]  Zhong Chen,et al.  Telecentric stereo micro-vision system: Calibration method and experiments , 2014 .

[25]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[26]  Qican Zhang,et al.  3-D shape measurement based on complementary Gray-code light , 2012 .

[27]  Yingchun Wu,et al.  Improved algorithm for phase-to-height mapping in phase measuring profilometry. , 2012, Applied optics.

[28]  Alfredo Paolillo,et al.  A New Calibration Procedure for 3-D Shape Measurement System Based on Phase-Shifting Projected Fringe Profilometry , 2009, IEEE Transactions on Instrumentation and Measurement.

[29]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[30]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Zhengyou Zhang,et al.  On the epipolar geometry between two images with lens distortion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[32]  J. Liu,et al.  Multi-Depth-of-Field 3-D Profilometry for a Microscopic System With Telecentric Lens , 2022, IEEE Transactions on Instrumentation and Measurement.

[33]  Arc,et al.  Automated calibration of multi-camera-projector structured light systems for volumetric high-speed 3 D surface reconstructions , 2018 .