High-resolution real-time 360° 3D model reconstruction of a handheld object with fringe projection profilometry.

The digitization of the complete shape of real objects has essential applications in fields of intelligent manufacturing, industrial detection, and reverse modeling. In order to build the full geometric models of rigid objects, the object must be moved relative to the measurement system (or the scanner must be moved relative to the object) to obtain and integrate views of the object from all sides, which not only complicates the system configuration but makes the whole process time-consuming. In this Letter, we present a high-resolution real-time 360° three-dimensional (3D) model reconstruction method that allows one to rotate an object manually and see a continuously updated 3D model during the scanning process. A multi-view fringe projection profilometry system acquires high-precision depth information about a handheld object from different perspectives and, meanwhile, the multiple views are aligned and merged together in real time. Our system employs stereo phase unwrapping and an adaptive depth constraint that can unwrap the phase of dense fringe images robustly without increasing the number of captured patterns. We then develop an efficient coarse-to-fine registration strategy to match the 3D surface segments rapidly. Our experiments demonstrate that our method can reconstruct the high-precision complete 3D model of complex objects under arbitrary rotation without any instrument assist and expensive pre/post-processing.

[1]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[2]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[3]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[4]  Xiang Peng,et al.  Strategy for automatic and complete three-dimensional optical digitization. , 2012, Optics letters.

[5]  Qican Zhang,et al.  Dynamic 3-D shape measurement method: A review , 2010 .

[6]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[7]  Qian Chen,et al.  High-speed real-time 3D shape measurement based on adaptive depth constraint. , 2018, Optics express.

[8]  Anand Asundi,et al.  Comparison of Fourier transform, windowed Fourier transform, and wavelet transform methods for phase extraction from a single fringe pattern in fringe projection profilometry , 2010 .

[9]  Qian Chen,et al.  Motion-artifact-free dynamic 3D shape measurement with hybrid Fourier-transform phase-shifting profilometry. , 2019, Optics express.

[10]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[11]  Matthias Nießner,et al.  Real-time 3D reconstruction at scale using voxel hashing , 2013, ACM Trans. Graph..

[12]  Zach DeVito,et al.  Opt , 2017 .

[13]  Bin Chen,et al.  Mirror-assisted panoramic-digital image correlation for full-surface 360-deg deformation measurement , 2019, Measurement.

[14]  Liang Zhang,et al.  Fringe pattern analysis using deep learning , 2018, Advanced Photonics.

[15]  Svenja Kahn,et al.  Towards precise real-time 3D difference detection for industrial applications , 2013, Comput. Ind..

[16]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[17]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[18]  Qian Chen,et al.  Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system. , 2016, Optics express.

[19]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[20]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[21]  Zonghua Zhang,et al.  Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques , 2012 .

[22]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[23]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.