Adaptive information retrieval in automated fringe based full-field optical metrology

Optical metrology provides very attractive means for noninvasive and highly accurate evaluation of different features of various objects. Information is acquired and processed over whole sensor area using so-called full-field methods. In coherent light techniques the measurand is stored in the complex amplitude of the optical field. Due to physical limitations the recorded intensity distribution is generally captured in a form of a fringe pattern with information encoded in phase and/or amplitude modulation distributions, hence the importance of their demodulation techniques. In this contribution several recently developed adaptive techniques for information retrieval in automated fringe based full-field optical metrology will be presented. Adaptivity constitutes advantage enabling robustness and versatility – presented methods adapt their performance according to characteristics of analyzed fringe patterns providing efficient means to successfully retrieve information obtained by various optical techniques, i.e., interferometry (classical two-beam, multi-beam, timeaveraged, speckle, grating), moiré and structured illumination. Developed fringe pattern demodulation techniques are based on the concept of single-frame processing using advanced image pre-filtering techniques, i.e., empirical mode decomposition and variational image decomposition. The phase/amplitude demodulation is conducted utilizing the 2D Hilbert transform and complex analytic signal paradigm. Applications of these specially tailored methods include but are not limited to: coherent phase microscopy for stationary and live biological objects (e.g., prostate cancer cells, red blood cells, semen cells etc.), vibration amplitude studies of technical microobjects, wavefront sensing, optical testing etc.

[1]  M. Trusiak,et al.  Hilbert–Huang transform based advanced Bessel fringe generation and demodulation for full-field vibration studies of specular reflection micro-objects , 2018, Optics and Lasers in Engineering.

[2]  Krzysztof Patorski,et al.  Two-frame tilt-shift error estimation and phase demodulation algorithm. , 2015, Optics letters.

[3]  Krzysztof Patorski,et al.  Highly contrasted Bessel fringe minima visualization for time-averaged vibration profilometry using Hilbert transform two-frame processing. , 2013, Optics express.

[4]  Zhenkun Lei,et al.  General filtering method for electronic speckle pattern interferometry fringe images with various densities based on variational image decomposition. , 2017, Applied optics.

[5]  Qian Kemao,et al.  Windowed Fourier transform for fringe pattern analysis. , 2004, Applied optics.

[6]  Guoying Feng,et al.  Spatial carrier phase-shifting algorithm based on principal component analysis method , 2012 .

[7]  J. Marroquín,et al.  Demodulation of a single interferogram by use of a two-dimensional regularized phase-tracking technique. , 1997, Applied optics.

[8]  Munther A Gdeisat,et al.  Spatial carrier fringe pattern demodulation by use of a two-dimensional continuous wavelet transform. , 2006, Applied optics.

[9]  Nii O. Attoh-Okine,et al.  Bidimensional Empirical Mode Decomposition Using Various Interpolation Techniques , 2009, Adv. Data Sci. Adapt. Anal..

[10]  Qian Kemao,et al.  Frequency guided methods for demodulation of a single fringe pattern. , 2009, Optics express.

[11]  Alejandro Federico,et al.  Normalization of fringe patterns using the bidimensional empirical mode decomposition and the Hilbert transform. , 2009, Applied optics.

[12]  Maciej Trusiak,et al.  Evaluation of adaptively enhanced two-shot fringe pattern phase and amplitude demodulation methods. , 2017, Applied optics.

[13]  M. Takeda,et al.  Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry , 1982 .

[14]  Maciej Trusiak,et al.  Hilbert-Huang processing for single-exposure two-dimensional grating interferometry. , 2013, Optics express.

[15]  D. Malacara,et al.  Interferogram Analysis for Optical Testing , 2018 .

[16]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[17]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[18]  Zehra Saraç,et al.  Phase recovery from interference fringes by using S-transform , 2008 .

[19]  M. Trusiak,et al.  Two-shot fringe pattern phase-amplitude demodulation using Gram-Schmidt orthonormalization with Hilbert-Huang pre-filtering. , 2015, Optics express.

[20]  Tomasz Kozacki,et al.  Fast and accurate phase-unwrapping algorithm based on the transport of intensity equation. , 2017, Applied optics.

[21]  J Antonio Quiroga,et al.  Two-step demodulation based on the Gram-Schmidt orthonormalization method. , 2012, Optics letters.

[22]  Jesmin F. Khan,et al.  A novel approach of fast and adaptive bidimensional empirical mode decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Li Kai,et al.  Improved generalized regularized phase tracker for demodulation of a single fringe pattern. , 2013, Optics express.

[24]  Maciej Trusiak,et al.  Modified variational image decomposition algorithm aided by the Hilbert transform as an alternative to 2D Hilbert-Huang transform for fringe pattern phase retrieval , 2018, Speckle: International Conference on Speckle Metrology.

[25]  Lionel R. Watkins,et al.  Review of fringe pattern phase recovery using the 1-D and 2-D continuous wavelet transforms , 2012 .

[26]  Tao Wang,et al.  Application of two-dimensional S-Transform in fringe pattern analysis , 2013 .

[27]  Xiang Zhou,et al.  Morphological operation-based bi-dimensional empirical mode decomposition for automatic background removal of fringe patterns. , 2012, Optics express.

[28]  K. Larkin.  Natural demodulation of two-dimensional fringe patterns. II. Stationary phase analysis of the spiral phase quadrature transform. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  Krzysztof Patorski,et al.  Circular-linear grating Talbot interferometry with moiré Fresnel imaging for beam collimation. , 2014, Optics letters.

[30]  Bongtae Han,et al.  Advanced iterative algorithm for phase extraction of randomly phase-shifted interferograms. , 2004, Optics letters.

[31]  Wenjing Chen,et al.  Application of S-transform profilometry in eliminating nonlinearity in fringe pattern. , 2012, Applied optics.

[32]  Yonggang Su,et al.  Image decomposition model Shearlet-Hilbert-L2 with better performance for denoising in ESPI fringe patterns. , 2018, Applied optics.

[33]  Krzysztof Patorski,et al.  Separation of complex fringe patterns using two-dimensional continuous wavelet transform. , 2012, Applied optics.

[34]  Wolfgang Osten,et al.  Improvement of the regularized phase tracking technique for the processing of nonnormalized fringe patterns. , 2002, Applied optics.

[35]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[36]  Maciej Trusiak,et al.  Optically-sectioned two-shot structured illumination microscopy with Hilbert-Huang processing. , 2014, Optics express.

[37]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[38]  Krzysztof Patorski,et al.  Hilbert-Huang single-shot spatially multiplexed interferometric microscopy. , 2018, Optics letters.

[39]  M. A. Oldfield,et al.  Natural demodulation of two-dimensional fringe patterns. I. General background of the spiral phase quadrature transform. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Krzysztof Patorski,et al.  Active microelement testing by interferometry using time-average and quasi-stroboscopic techniques , 2003, SPIE Optical Metrology.

[41]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[42]  M. Servin,et al.  Fringe-follower regularized phase tracker for demodulation of closed-fringe interferograms , 2001 .

[43]  Christophe Damerval,et al.  A fast algorithm for bidimensional EMD , 2005, IEEE Signal Processing Letters.

[44]  Krzysztof Patorski,et al.  Quantitative phase imaging by single-shot Hilbert-Huang phase microscopy. , 2016, Optics letters.

[45]  Antonin Chambolle,et al.  Dual Norms and Image Decomposition Models , 2005, International Journal of Computer Vision.

[46]  Krzysztof Patorski,et al.  Diffraction grating three-beam interferometry without self-imaging regime contrast modulations. , 2015, Optics letters.

[47]  Wang-Q Lim,et al.  The Discrete Shearlet Transform: A New Directional Transform and Compactly Supported Shearlet Frames , 2010, IEEE Transactions on Image Processing.

[48]  K. Patorski,et al.  Evaluation of amplitude encoded fringe patterns using the bidimensional empirical mode decomposition and the 2D Hilbert transform generalizations. , 2011, Applied optics.

[49]  Juan Antonio Quiroga Mellado,et al.  Isotropic n-dimensional fringe pattern normalization , 2003 .

[50]  Noé Alcalá Ochoa,et al.  Normalization and noise-reduction algorithm for fringe patterns , 2007 .

[51]  Maciej Trusiak,et al.  Single-shot two-channel Talbot interferometry using checker grating and Hilbert-Huang fringe pattern processing , 2014, Photonics Europe.

[52]  Qian Kemao,et al.  A generalized regularized phase tracker for demodulation of a single fringe pattern. , 2012, Optics express.

[53]  Barbara Putz,et al.  Fast and adaptive bidimensional empirical mode decomposition for the real-time video fusion , 2012, 2012 15th International Conference on Information Fusion.

[54]  Zhaoyang Wang,et al.  Two-dimensional continuous wavelet transform algorithm for phase extraction of two-step arbitrarily phase-shifted interferograms , 2014 .

[55]  Malgorzata Kujawinska,et al.  Spatial-carrier phase-shifting technique of fringe pattern analysis , 1991, Other Conferences.

[56]  J A Quiroga,et al.  Adaptive monogenic filtering and normalization of ESPI fringe patterns. , 2005, Optics letters.

[57]  Joanna Schmit,et al.  N-point spatial phase-measurement techniques for non-destructive testing , 1996 .

[58]  Alejandro Federico,et al.  Noise reduction in digital speckle pattern interferometry using bidimensional empirical mode decomposition. , 2008, Applied optics.

[59]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[60]  Juan Antonio Quiroga Mellado,et al.  Algorithm for fringe pattern normalization , 2001 .

[61]  Maciej Trusiak,et al.  Advanced processing of optical fringe patterns by automated selective reconstruction and enhanced fast empirical mode decomposition , 2014 .

[62]  Qian Kemao,et al.  Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations , 2007 .

[63]  Qian Kemao,et al.  Windowed Fourier transform for fringe pattern analysis: theoretical analyses. , 2008, Applied optics.

[64]  Krzysztof Patorski,et al.  Single-shot 3 × 3 beam grating interferometry for self-imaging free extended range wave front sensing. , 2016, Optics letters.

[65]  Linlin Wang,et al.  Phase retrieval from single frame projection fringe pattern with variational image decomposition , 2014 .

[66]  Yonggang Su,et al.  Variational image decomposition for estimation of fringe orientation and density from electronic speckle pattern interferometry fringe patterns with greatly variable density , 2016 .

[67]  Chen Tang,et al.  A 3D shape retrieval method for orthogonal fringe projection based on a combination of variational image decomposition and variational mode decomposition , 2016 .

[68]  Krzysztof Patorski,et al.  Handbook of the moiré fringe technique , 1993 .

[69]  Krzysztof Patorski,et al.  Adaptive enhancement of optical fringe patterns by selective reconstruction using FABEMD algorithm and Hilbert spiral transform. , 2012, Optics express.

[70]  Jesmin F. Khan,et al.  Fast and Adaptive Bidimensional Empirical Mode Decomposition Using Order-Statistics Filter Based Envelope Estimation , 2008, EURASIP J. Adv. Signal Process..

[71]  Yonggang Su,et al.  Gradient vector fields based on variational image decomposition for skeletonization of electronic speckle pattern interferometry fringe patterns with variable density and their applications. , 2016, Applied optics.

[72]  Yi Zhou,et al.  Adaptive noise reduction method for DSPI fringes based on bi-dimensional ensemble empirical mode decomposition. , 2011, Optics express.

[73]  Krzysztof Patorski,et al.  Fourier domain interpretation of real and pseudo-moiré phenomena. , 2011, Optics express.

[74]  Maciej Trusiak,et al.  Single shot fringe pattern phase demodulation using Hilbert-Huang transform aided by the principal component analysis. , 2016, Optics express.

[75]  Krzysztof Patorski,et al.  Examination of singular scalar light fields using wavelet processing of fork fringes. , 2011, Applied optics.

[76]  Xinjun Zhu,et al.  Variational image decomposition for automatic background and noise removal of fringe patterns. , 2013, Optics letters.

[77]  Yi Zhou,et al.  A de-illumination scheme for face recognition based on fast decomposition and detail feature fusion. , 2013, Optics express.

[78]  Tao Yang,et al.  Multivariate empirical mode decomposition approach for adaptive denoising of fringe patterns. , 2012, Optics letters.

[79]  Huanfeng Ma,et al.  Advanced continuous wavelet transform algorithm for digital interferogram analysis and processing , 2006 .

[80]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[81]  Maciej Trusiak,et al.  Single-frame fringe pattern analysis using modified variational image decomposition aided by the Hilbert transform for fast full-field quantitative phase imaging , 2018, Photonics Europe.

[82]  Maciej Trusiak,et al.  Space domain interpretation of incoherent moiré superimpositions using FABEMD , 2012, Other Conferences.

[83]  Krzysztof Patorski,et al.  Visualization of additive-type moiré and time-average fringe patterns using the continuous wavelet transform. , 2010, Applied optics.

[84]  Krzysztof Patorski,et al.  Processing and phase analysis of fringe patterns with contrast reversals. , 2013, Optics express.