Super-resolution quantitative phase imaging of out-of-focus images based on deep learning

Quantitative phase information which can reflect the internal structure and refractive index distribution of the object is able to be obtained by diffractive and interferometry techniques. However, the phase resolution achieved by the diffraction method is lower than that of interferometry method; while the setup for interferometry method is more complex. To obtain high-resolution phase images without reference beam path, we propose an end-to-end DL based super resolved quantitative phase imaging method (AF-SRQPI) based on generative adversarial network (GAN) to transform low-resolution amplitude images into super-resolved phase images. Meanwhile, considering the inevitable out-focusing during the long hours of observing, autofocusing function is also included by the network. In the training process, out-of-focus low-resolution amplitude images are used as the inputs and corresponding super-resolved phase images obtained by structured illumination digital holographic microscopy (SI-DHM) are used as the ground truth labels. The well-trained network can reconstruct the high-resolution phase image at high speed (20fps) from a single-shot out-of-focus amplitude image. Comparing with other DL-based reconstruction schemes, the proposed method can perform autofocusing and superresolution phase imaging simultaneously. The simulation results verify that the high-resolution quantitative phase images of different biological samples can be reconstructed by using AF-SRQPI .

[1]  Beop-Min Kim,et al.  Single-shot digital holographic microscopy for quantifying a spatially-resolved Jones matrix of biological specimens. , 2016, Optics express.

[2]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Wolfgang Osten,et al.  Structured illumination for resolution enhancement and autofocusing in digital holographic microscopy. , 2013, Optics letters.

[4]  Xiaopeng Shao,et al.  Opposite-view digital holographic microscopy with autofocusing capability , 2017, Scientific Reports.

[5]  Tathagato Rai Dastidar,et al.  Whole slide imaging system using deep learning-based automated focusing. , 2019, Biomedical optics express.

[6]  Yibo Zhang,et al.  Deep Learning Microscopy , 2017, ArXiv.

[7]  Klaus Hahn,et al.  Digital autofocus methods for automated microscopy. , 2006, Methods in enzymology.

[8]  Aydogan Ozcan,et al.  Edge sparsity criterion for robust holographic autofocusing. , 2017, Optics letters.

[9]  Bahram Javidi,et al.  Refocusing criterion via sparsity measurements in digital holography. , 2014, Optics letters.

[10]  E. Abbe Beiträge zur Theorie des Mikroskops und der mikroskopischen Wahrnehmung , 1873 .

[11]  Jorge Garcia-Sucerquia,et al.  Accurate single-shot quantitative phase imaging of biological specimens with telecentric digital holographic microscopy , 2014, Journal of biomedical optics.

[12]  Demetri Psaltis,et al.  Multimode optical fiber transmission with a deep learning network , 2018, Light: Science & Applications.

[13]  G. Pedrini,et al.  DL-SI-DHM: a deep network generating the high-resolution phase and amplitude images from wide-field images. , 2021, Optics express.

[14]  Ming Lei,et al.  Autofocusing of digital holographic microscopy based on off-axis illuminations. , 2012, Optics letters.

[15]  M. Lohse,et al.  All-optical microscope autofocus based on an electrically tunable lens and a totally internally reflected IR laser. , 2018, Optics express.

[16]  Shaowei Jiang,et al.  Transform- and multi-domain deep learning for single-frame rapid autofocusing in whole slide imaging. , 2018, Biomedical optics express.

[17]  Xiangnan Wang,et al.  Fast phase retrieval in off-axis digital holographic microscopy through deep learning. , 2018, Optics express.

[18]  Chenliang Chang,et al.  Phase-shifting-free resolution enhancement in digital holographic microscopy under structured illumination. , 2018, Optics express.

[19]  C. Depeursinge,et al.  Quantitative phase imaging in biomedicine , 2012, 2012 Conference on Lasers and Electro-Optics (CLEO).

[20]  Aydogan Ozcan,et al.  Single-shot autofocusing of microscopy images using deep learning , 2020, ArXiv.