Fully automated extraction of the fringe skeletons in dynamic electronic speckle pattern interferometry using a U-Net convolutional neural network

Abstract. With the development of artificial intelligence technology, intelligent fringe processing is a goal of relevant researchers in optical interferometry. We propose an intelligent method to achieve fully automated extraction of the fringe skeletons in electronic speckle pattern interferometry (ESPI) based on U-Net convolutional neural network. In the proposed method, the network is first trained by the samples that consist of the noisy ESPI fringe patterns and the corresponding skeleton images. After training, the other multiframe ESPI fringe patterns are fed to the trained network simultaneously; the corresponding skeleton images can be obtained in batches. Using our method, it is not necessary to process fringe patterns frame by frame. Our method is especially suitable for multiframe fringe patterns processing. We apply the intelligent method to one computer-simulated and one real-dynamic ESPI measurement, respectively. For the simulated measurement, it takes just 40 s to obtain the skeleton images of 20 noisy ESPI fringe patterns using our method. Even for low-quality experimental obtained ESPI fringe patterns, our method can also give desired results.

[1]  Alejandro F. Frangi,et al.  Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015 , 2015, Lecture Notes in Computer Science.

[2]  Gao Wang,et al.  Application of the radial basis function interpolation to phase extraction from a single electronic speckle pattern interferometric fringe. , 2011, Applied optics.

[3]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[4]  Yefan Cai,et al.  A novel automated approach for noise detection in interference fringes pattern images using feature learning , 2018, Other Conferences.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Patrick Henry Winston,et al.  Artificial intelligence: an mit perspective , 1979 .

[7]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[8]  Cédric Thizy,et al.  Vibration mode shapes visualization in industrial environment by real-time time-averaged phase-stepped electronic speckle pattern interferometry at 10.6  μm and shearography at 532 nm , 2016 .

[9]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[10]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[11]  Chenggen Quan,et al.  Phase extraction from a single fringe pattern based on guidance of an extreme map. , 2005, Applied optics.

[12]  Roger M. Groves,et al.  Statistically guided improvements in speckle phase discontinuity predictions by machine learning systems , 2013 .

[13]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hao Chen,et al.  VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation , 2016, ArXiv.

[15]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[16]  Wei Li,et al.  DeepUNet: A Deep Fully Convolutional Network for Pixel-Level Sea-Land Segmentation , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[18]  Chen Tang,et al.  Denoising by coupled partial differential equations and extracting phase by backpropagation neural networks for electronic speckle pattern interferometry. , 2007, Applied optics.

[19]  Fang Zhang,et al.  Performance evaluation of partial differential equation models in electronic speckle pattern interferometry and the delta-mollification phase map method. , 2006, Applied optics.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Yonggang Su,et al.  Gradient vector fields based on variational image decomposition for skeletonization of electronic speckle pattern interferometry fringe patterns with variable density and their applications. , 2016, Applied optics.

[22]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[23]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[24]  Chen Tang,et al.  Oriented couple gradient vector fields for skeletonization of gray-scale optical fringe patterns with high density. , 2010, Applied optics.

[25]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..

[26]  Sébastien Ourselin,et al.  On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Task , 2017, IPMI.

[27]  David Bull,et al.  Application of Machine Learning to Classification of Volcanic Deformation in Routinely Generated InSAR Data , 2018, Journal of Geophysical Research: Solid Earth.

[28]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[29]  Jiangtao Xi,et al.  Skeleton extraction and phase interpolation for single ESPI fringe pattern based on the partial differential equations. , 2015, Optics express.

[30]  Ming Zhang,et al.  Real-time one-point out-of-plane displacement measurement system using electronic speckle pattern interferometry , 2016 .

[31]  Marc P. Georges,et al.  Use of specklegrams background terms for speckle photography combined with phase-shifting electronic speckle pattern interferometry , 2015 .

[32]  Gao Wang,et al.  Nearly preprocessing-free method for skeletonization of gray-scale electronic speckle pattern interferometry fringe patterns via partial differential equations. , 2008, Optics letters.