One-shot fringe pattern analysis based on deep learning image denoiser

Abstract. Extracting phase from a single-frame fringe pattern is a key and challenging problem in fringe projection 3D measurement, especially for dynamic 3D measurement. We propose a single-shot phase extraction approach based on a low-pass filter with a well-trained image denoiser. Various comparative experiments have verified the effectiveness of the proposed method. More importantly, we associate the single-shot phase extraction problem with image denoising using deep learning. Thus more existing well-designed deep neural network models can be reused in the proposed method, without having to design a new model.

[1]  Qian Kemao,et al.  Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations , 2007 .

[2]  Liang Zhang,et al.  Fringe pattern analysis using deep learning , 2018, Advanced Photonics.

[3]  Huanfeng Ma,et al.  Advanced continuous wavelet transform algorithm for digital interferogram analysis and processing , 2006 .

[4]  Jianlin Zhao,et al.  One-step robust deep learning phase unwrapping. , 2019, Optics express.

[5]  Xianyu Su,et al.  Phase-height mapping and coordinate calibration simultaneously in phase-measuring profilometry , 2004 .

[6]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Xinjun Zhu,et al.  Shearlet transform for phase extraction in fringe projection profilometry with edges discontinuity , 2016 .

[8]  Guohua Gu,et al.  Micro deep learning profilometry for high-speed 3D surface imaging , 2019, Optics and Lasers in Engineering.

[9]  Xiang Zhou,et al.  Morphological operation-based bi-dimensional empirical mode decomposition for automatic background removal of fringe patterns. , 2012, Optics express.

[10]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[11]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[13]  Wangmeng Zuo,et al.  Toward Convolutional Blind Denoising of Real Photographs , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Chen Tang,et al.  A 3D shape retrieval method for orthogonal fringe projection based on a combination of variational image decomposition and variational mode decomposition , 2016 .

[15]  Jian Yang,et al.  MemNet: A Persistent Memory Network for Image Restoration , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[17]  Yang Song,et al.  Fourier transform profilometry based on convolution neural network , 2018, SPIE/COS Photonics Asia.

[18]  Qinghua Guo,et al.  Label enhanced and patch based deep learning for phase retrieval from single frame fringe pattern in fringe projection 3D measurement. , 2019, Optics express.

[19]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[20]  Jing Xu,et al.  High-accuracy, high-speed 3D structured light imaging techniques and potential applications to intelligent robotics , 2017, International Journal of Intelligent Robotics and Applications.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[23]  M. Takeda,et al.  Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry , 1982 .

[24]  Gang Qiao,et al.  A single-shot phase retrieval method for phase measuring deflectometry based on deep learning , 2020 .

[25]  Linlin Wang,et al.  Phase retrieval from single frame projection fringe pattern with variational image decomposition , 2014 .

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Song Zhang,et al.  Absolute phase retrieval methods for digital fringe projection profilometry: A review , 2018 .