Machine-learning based fast unsupervised variational image decomposition for fringe pattern analysis

The unsupervised variational image decomposition (uVID) algorithm developed in our group allows for automatic, accurate and robust preprocessing of diverse fringe patterns. Classical VID was initially used for image denoising. Its tailoring for fringe pattern preprocessing was justified by clear advantage over other methods (e.g. Wiener or Gauss filters) in maintaining sharp edges and details of the image. Historically first fringe pattern dedicated three-component variational image decomposition model assumed the use of the shearlet algorithm to separate the information component (fringes) and noise and the Chambolle projection algorithm to separate the fringes and background. We noticed that this model is computationally complicated and the result strongly depends on the values of the algorithm’s internal parameters, to be set manually. The uVID automatically introduces the parameters and stopping criterion for Chambolle’s iterative projection algorithm. Nevertheless, determining the stopping criterion in each iteration is a severely time-consuming process, which is particularly important given the fact that in many cases thousands of iterations have to be calculated in order to obtain a satisfactory fringe pattern decomposition result. Therefore, the idea of using machine learning algorithms to classify fringe patterns according to the required number of Chambolle projection iterations has emerged. Thus, it is no longer required to determine the value of the stopping criterion in every iteration, but only in the area of the predetermined number of iterations. We showed that the calculation time is reduced on average by half by employing the machine-learning based acceleration. This way we made a progress in developing uVID algorithm features for real-time studies of dynamic phenomena, i.e., biological cell development investigated by fringe-based bio-interferometry methods.

[1]  Krzysztof Patorski,et al.  Adaptive enhancement of optical fringe patterns by selective reconstruction using FABEMD algorithm and Hilbert spiral transform. , 2012, Optics express.

[2]  Catalina Sbert,et al.  Chambolle's Projection Algorithm for Total Variation Denoising , 2013, Image Process. Line.

[3]  Chao Zuo,et al.  Variational Hilbert Quantitative Phase Imaging , 2020, Scientific Reports.

[4]  Antonin Chambolle,et al.  Dual Norms and Image Decomposition Models , 2005, International Journal of Computer Vision.

[5]  Linlin Wang,et al.  Phase retrieval from single frame projection fringe pattern with variational image decomposition , 2014 .

[6]  Malgorzata Kujawinska,et al.  Two directional spatial-carrier phase-shifting method for analysis of crossed and closed fringe patterns , 1995 .

[7]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[8]  Maciej Trusiak,et al.  Automatized fringe pattern preprocessing using unsupervised variational image decomposition. , 2019, Optics express.

[9]  Maciej Trusiak,et al.  Advanced processing of optical fringe patterns by automated selective reconstruction and enhanced fast empirical mode decomposition , 2014 .

[10]  Krzysztof Patorski,et al.  Handbook of the moiré fringe technique , 1993 .

[11]  Evan Evans,et al.  Mechanics and Thermodynamics of Biomembranes , 2017 .

[12]  Marc Lebrun,et al.  An Analysis and Implementation of the BM3D Image Denoising Method , 2012, Image Process. Line.

[13]  M. Takeda,et al.  Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry , 1982 .

[14]  Xinjun Zhu,et al.  Variational image decomposition for automatic background and noise removal of fringe patterns. , 2013, Optics letters.

[15]  Krzysztof Patorski,et al.  Hilbert-Huang single-shot spatially multiplexed interferometric microscopy. , 2018, Optics letters.

[16]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[17]  Maciej Trusiak,et al.  Optically-sectioned two-shot structured illumination microscopy with Hilbert-Huang processing. , 2014, Optics express.

[18]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[19]  S Dehaeck,et al.  Analyzing closed-fringe images using two-dimensional Fan wavelets. , 2015, Applied optics.

[20]  Krzysztof Patorski,et al.  Quantitative phase imaging by single-shot Hilbert-Huang phase microscopy. , 2016, Optics letters.

[21]  G. T. Reid,et al.  Interferogram Analysis: Digital Fringe Pattern Measurement Techniques , 1994 .

[22]  B. Kemper,et al.  Digital holographic microscopy for live cell applications and technical inspection. , 2008, Applied optics.

[23]  Krzysztof Patorski,et al.  Active microelement testing by interferometry using time-average and quasi-stroboscopic techniques , 2003, SPIE Optical Metrology.

[24]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Myung K. Kim Digital Holographic Microscopy: Principles, Techniques, and Applications , 2011 .

[26]  Maciej Trusiak,et al.  Single-frame fringe pattern analysis using modified variational image decomposition aided by the Hilbert transform for fast full-field quantitative phase imaging , 2018, Photonics Europe.

[27]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[28]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[29]  Maciej Trusiak,et al.  Single shot fringe pattern phase demodulation using Hilbert-Huang transform aided by the principal component analysis. , 2016, Optics express.

[30]  B. Wattellier,et al.  Quadriwave lateral shearing interferometry for quantitative phase microscopy of living cells. , 2009, Optics express.

[31]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[32]  Myung K. Kim Principles and techniques of digital holographic microscopy , 2010 .

[33]  Huanfeng Ma,et al.  Advanced continuous wavelet transform algorithm for digital interferogram analysis and processing , 2006 .

[34]  Maciej Trusiak,et al.  Modified variational image decomposition algorithm aided by the Hilbert transform as an alternative to 2D Hilbert-Huang transform for fringe pattern phase retrieval , 2018, Speckle: International Conference on Speckle Metrology.

[35]  Krzysztof Patorski,et al.  Processing and phase analysis of fringe patterns with contrast reversals. , 2013, Optics express.

[36]  Bongtae Han,et al.  Advanced iterative algorithm for phase extraction of randomly phase-shifted interferograms. , 2004, Optics letters.

[37]  Zeev Zalevsky,et al.  Spatially-multiplexed interferometric microscopy (SMIM): converting a standard microscope into a holographic one. , 2014, Optics express.