Novel phase retrieval based on deep learning for fringe projection profilometry by only using one single fringe

Fringe projection profilometry (FPP) has become increasingly important for 3-D shape measurement because of its attributes of high-resolution, high-accuracy, and high-speed, etc. In the FPP, a phase retrieval process is necessary to retrieve the desired phase before the 3-D shape reconstruction, which usually includes two steps of phase calculation and phase unwrapping. Traditional techniques always require more than one fringe for successful phase retrieval, which is difficult to be used for dynamic 3-D measurement. In this paper, a novel phase retrieval technique based on deep learning is proposed by only using one single fringe, and the desired phase can be successfully retrieved by using the deep learning with one single network. The proposed phase retrieval technique shows great potential for dynamic 3-D measurement. Theoretical analysis and experiments are provided to verify its performance.

[1]  Luis Miguel Bergasa,et al.  Efficient ConvNet for real-time semantic segmentation , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[2]  Jing Xu,et al.  High-accuracy, high-speed 3D structured light imaging techniques and potential applications to intelligent robotics , 2017, International Journal of Intelligent Robotics and Applications.

[3]  Liang Zhang,et al.  Fringe pattern analysis using deep learning , 2018, Advanced Photonics.

[4]  Shijie Feng,et al.  High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection , 2013 .

[5]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[6]  Yajun Wang,et al.  Novel phase-coding method for absolute phase retrieval. , 2012, Optics letters.

[7]  Song Zhang,et al.  Absolute phase retrieval methods for digital fringe projection profilometry: A review , 2018 .

[8]  Dongliang Zheng,et al.  Phase-shifting profilometry combined with Gray-code patterns projection: unwrapping error removal by an adaptive median filter. , 2017, Optics express.

[9]  Guohua Gu,et al.  Micro deep learning profilometry for high-speed 3D surface imaging , 2019, Optics and Lasers in Engineering.

[10]  Munther A Gdeisat,et al.  Spatial carrier fringe pattern demodulation by use of a two-dimensional continuous wavelet transform. , 2006, Applied optics.

[11]  Alejandro Federico,et al.  Normalization of fringe patterns using the bidimensional empirical mode decomposition and the Hilbert transform. , 2009, Applied optics.

[12]  Dongliang Zheng,et al.  Ternary Gray code-based phase unwrapping for 3D measurement using binary patterns with projector defocusing. , 2017, Applied optics.

[13]  Dongliang Zheng,et al.  Phase error analysis and compensation for phase shifting profilometry with projector defocusing. , 2016, Applied optics.

[14]  Dongliang Zheng,et al.  Phase coding method for absolute phase retrieval with a large number of codewords. , 2012, Optics express.

[15]  Dongliang Zheng,et al.  Self-correction phase unwrapping method based on Gray-code light , 2012 .

[16]  Jiangtao Xi,et al.  Frequency selection in absolute phase maps recovery with two frequency projection fringes. , 2012, Optics express.

[17]  Qian Chen,et al.  High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping , 2019, Optics and Lasers in Engineering.

[18]  Qian Chen,et al.  A new microscopic telecentric stereo vision system - Calibration, rectification, and three-dimensional reconstruction , 2019, Optics and Lasers in Engineering.

[19]  Reinhold Ritter,et al.  3-D shape measurement of complex objects by combining photogrammetry and fringe projection , 2000 .

[20]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[21]  Anton van den Hengel,et al.  High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks , 2016, ArXiv.

[22]  J. M. Huntley,et al.  Temporal phase-unwrapping algorithm for automated interferogram analysis. , 1993, Applied optics.

[23]  Qian Kemao,et al.  Windowed Fourier transform for fringe pattern analysis. , 2004, Applied optics.

[24]  Song Zhang,et al.  Flexible 3D shape measurement using projector defocusing: extended measurement range. , 2010, Optics letters.

[25]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[26]  Zhang Liang,et al.  High dynamic range 3D measurements with fringe projection profilometry: a review , 2018 .