High dynamic range real-time 3D measurement based on Fourier transform profilometry

Abstract The high dynamic range (HDR) fringe projection technique is widely used to measure the three-dimensional (3D) shapes of objects with shiny surfaces; however, it tends to compromise when measuring the dynamic objects. To reduce the number of images and improve the real-time performance, a Fourier transform profilometry (FTP)-based method that can increase the dynamic range for real-time 3D measurement is proposed. Firstly, single-color patterns are projected onto the measured object, and one captured color image can be separated into three monochrome images with different intensities by taking advantage of the different responses of R, G, and B channels. Second, the HDR fringe pattern is generated by compositing three monochrome images, and then processed by the background-normalized algorithm to obtain the final fringe pattern. Subsequently, FTP is employed to retrieve the phase map and obtain the 3D shape. The experimental results demonstrated that the proposed method can measure the dynamic objects with shiny surfaces in real-time 3D measurement system.

[1]  Qian Chen,et al.  Real-time high dynamic range 3D measurement using fringe projection. , 2020, Optics express.

[2]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[3]  Shijie Feng,et al.  High-dynamic-range 3D shape measurement based on time domain superposition , 2019, Measurement Science and Technology.

[4]  T. Ozaki,et al.  Real-time high-speed three-dimensional surface imaging using band-limited illumination profilometry with a CoaXPress interface. , 2020, Optics letters.

[5]  Gui-hua Liu,et al.  3D shape measurement of objects with high dynamic range of surface reflectivity. , 2011, Applied optics.

[6]  Shan Jiang,et al.  Real-Time Dynamic 3D Shape Reconstruction with SWIR InGaAs Camera , 2020, Sensors.

[7]  S. Ri,et al.  Intensity range extension method for three-dimensional shape measurement in phase-measuring profilometry using a digital micromirror device camera. , 2008, Applied optics.

[8]  Song Zhang,et al.  High dynamic range scanning technique , 2009 .

[9]  Song Zhang,et al.  High dynamic range real-time 3D shape measurement. , 2016, Optics express.

[10]  Yanjun Fu,et al.  A real-time 3D shape measurement with color texture using a monochromatic camera , 2020 .

[11]  Shijie Feng,et al.  General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique , 2014 .

[12]  Shijie Feng,et al.  Optimal wavelength selection strategy in temporal phase unwrapping with projection distance minimization. , 2018, Applied optics.

[13]  Song Zhang,et al.  Rapid and automatic optimal exposure control for digital fringe projection technique , 2020 .

[14]  Hui Lin,et al.  Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment , 2017 .

[15]  Chao Chen,et al.  Adaptive projection intensity adjustment for avoiding saturation in three-dimensional shape measurement , 2018 .

[16]  Qian Chen,et al.  Microscopic 3D measurement of shiny surfaces based on a multi-frequency phase-shifting scheme , 2018 .

[17]  Basel Salahieh,et al.  Multi-polarization fringe projection imaging for high dynamic range objects. , 2014, Optics express.

[18]  Jonathan Kofman,et al.  Real-time 3D surface-shape measurement using background-modulated modified Fourier transform profilometry with geometry-constraint , 2019, Optics and Lasers in Engineering.

[19]  Xiang Peng,et al.  Strategy for automatic and complete three-dimensional optical digitization. , 2012, Optics letters.

[20]  Anand K. Asundi,et al.  Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10, 000 frames per second , 2017, ArXiv.

[21]  Zhang Liang,et al.  High-speed high dynamic range 3D shape measurement based on deep learning , 2020 .

[22]  Lianxin Zhang,et al.  An effective framework for 3D shape measurement of specular surface based on the dichromatic reflection model , 2020 .

[23]  Yi Zheng,et al.  Real-time high-dynamic-range fringe acquisition for 3D shape measurement with a RGB camera , 2019, Measurement Science and Technology.

[24]  Yanjun Fu,et al.  A novel high dynamic range 3D measurement method based on adaptive fringe projection technique , 2020 .

[25]  Faramarz Farahi,et al.  Dynamics range enhancement in digital fringe projection technique , 2015 .

[26]  Huijie Zhao,et al.  Rapid in-situ 3D measurement of shiny object based on fast and high dynamic range digital fringe projector , 2014 .

[27]  Tong Guo,et al.  Simple, flexible calibration of phase calculation-based three-dimensional imaging system. , 2011, Optics letters.

[28]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[29]  Richard Kowarschik,et al.  Adaptive optical 3-D-measurement with structured light , 2000 .

[30]  Beiwen Li,et al.  High-dynamic-range 3D shape measurement utilizing the transitioning state of digital micromirror device , 2018, Optics and Lasers in Engineering.

[31]  Anand Asundi,et al.  Fast three-dimensional measurements for dynamic scenes with shiny surfaces , 2017 .

[32]  Hao Jiang,et al.  High dynamic range imaging for fringe projection profilometry with single-shot raw data of the color camera , 2017 .

[33]  Hualie Jiang,et al.  A high dynamic range structured light means for the 3D measurement of specular surface , 2017 .

[34]  Dong Li,et al.  Adaptive fringe-pattern projection for image saturation avoidance in 3D surface-shape measurement. , 2014, Optics express.

[35]  Zhang Liang,et al.  High dynamic range 3D measurements with fringe projection profilometry: a review , 2018 .

[36]  Qian Chen,et al.  High-resolution real-time 360° 3D model reconstruction of a handheld object with fringe projection profilometry. , 2019, Optics letters.

[37]  Lu Wang,et al.  Real-time three-dimensional shape measurement based on color binary fringe projection , 2019 .

[38]  C. Waddington,et al.  Analysis of measurement sensitivity to illuminance and fringe-pattern gray levels for fringe-pattern projection adaptive to ambient lighting , 2010 .

[39]  Hui Lin,et al.  Adaptive digital fringe projection technique for high dynamic range three-dimensional shape measurement. , 2016, Optics express.

[40]  Nan Gao,et al.  Adaptive pixel-to-pixel projection intensity adjustment for measuring a shiny surface using orthogonal color fringe pattern projection , 2018 .

[41]  Jing Xu,et al.  A Robust Surface Coding Method for Optically Challenging Objects Using Structured Light , 2014, IEEE Transactions on Automation Science and Engineering.