Auto-focusing and quantitative phase imaging using deep learning for the incoherent illumination microscopy system.

It is well known that the quantitative phase information which is vital in the biomedical study is hard to be directly obtained with bright-field microscopy under incoherent illumination. In addition, it is impossible to maintain the living sample in focus over long-term observation. Therefore, both the autofocusing and quantitative phase imaging techniques have to be solved in microscopy simultaneously. Here, we propose a lightweight deep learning-based framework, which is constructed by residual structure and is constrained by a novel loss function model, to realize both autofocusing and quantitative phase imaging. It outputs the corresponding in-focus amplitude and phase information at high speed (10fps) from a single-shot out-of-focus bright-field image. The training data were captured with a designed system under a hybrid incoherent and coherent illumination system. The experimental results verify that the focused and quantitative phase images of non-biological samples and biological samples can be reconstructed by using the framework. It provides a versatile quantitative technique for continuous monitoring of living cells in long-term and label-free imaging by using a traditional incoherent illumination microscopy system.

[1]  Woei Ming Lee,et al.  Holo-UNet: hologram-to-hologram neural network restoration for high fidelity low light quantitative phase imaging of live cells. , 2020, Biomedical optics express.

[2]  H. Pham,et al.  Diffraction phase microscopy with white light. , 2012, Optics letters.

[3]  Qiang Zhang,et al.  Integrating quantum key distribution with classical communications in backbone fiber network. , 2017, Optics express.

[4]  Hiroshi Ishikawa,et al.  Retinal optical coherence tomography image enhancement via deep learning. , 2018, Biomedical optics express.

[5]  Jiliu Zhou,et al.  Simultaneous denoising and super-resolution of optical coherence tomography images based on generative adversarial network. , 2019, Optics express.

[6]  Caojin Yuan,et al.  Numerical dark-field imaging using deep-learning. , 2020, Optics express.

[7]  Jianlin Zhao,et al.  Transport of intensity equation from a single intensity image via deep learning , 2020 .

[8]  Henry Pinkard,et al.  Deep learning for single-shot autofocus microscopy , 2019, Optica.

[9]  Shuai Li,et al.  Lensless computational imaging through deep learning , 2017, ArXiv.

[10]  Aydogan Ozcan,et al.  Single-shot autofocusing of microscopy images using deep learning , 2020, ArXiv.

[11]  Guohai Situ,et al.  eHoloNet: a learning-based end-to-end approach for in-line digital holographic reconstruction. , 2018, Optics express.

[12]  Xiangnan Wang,et al.  Fast phase retrieval in off-axis digital holographic microscopy through deep learning. , 2018, Optics express.

[13]  Xin Jin,et al.  Infrared and visual image fusion method based on discrete cosine transform and local spatial frequency in discrete stationary wavelet transform domain , 2018 .

[14]  Zhuo Xu,et al.  Ghost Imaging Based on Deep Learning , 2018, Scientific Reports.

[15]  Takanori Nomura,et al.  Object plane detection and phase-amplitude imaging based on transport of intensity equation , 2017 .

[16]  Tathagato Rai Dastidar,et al.  Whole slide imaging system using deep learning-based automated focusing. , 2019, Biomedical optics express.

[17]  Kaikai Guo,et al.  InstantScope: a low-cost whole slide imaging system with instant focal plane detection. , 2015, Biomedical optics express.

[18]  Yibo Zhang,et al.  Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery , 2018, Optica.

[19]  Qian Kemao,et al.  Y-Net: a one-to-two deep learning framework for digital holographic reconstruction. , 2019, Optics letters.

[20]  Zibang Zhang,et al.  Single-frame rapid autofocusing for brightfield and fluorescence whole slide imaging. , 2016, Biomedical optics express.

[21]  M. Lohse,et al.  All-optical microscope autofocus based on an electrically tunable lens and a totally internally reflected IR laser. , 2018, Optics express.

[22]  Shaowei Jiang,et al.  Transform- and multi-domain deep learning for single-frame rapid autofocusing in whole slide imaging. , 2018, Biomedical optics express.

[23]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[24]  Gabriel Popescu,et al.  Label-free quantitative evaluation of breast tissue using Spatial Light Interference Microscopy (SLIM) , 2018, Scientific Reports.

[25]  Kazuo Umemura,et al.  Label-free imaging and analysis of subcellular parts of a living diatom cylindrotheca sp. using optical diffraction tomography , 2020, MethodsX.

[26]  A. Piancastelli,et al.  Phototoxic action of light emitting diode in the in vitro viability of Trichophyton rubrum. , 2012, Anais brasileiros de dermatologia.

[27]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[28]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[29]  George Barbastathis,et al.  Low Photon Count Phase Retrieval Using Deep Learning. , 2018, Physical review letters.

[30]  Demetri Psaltis,et al.  Multimode optical fiber transmission with a deep learning network , 2018, Light: Science & Applications.

[31]  Edmund Y. Lam,et al.  End-to-end deep learning framework for digital holographic reconstruction , 2019, Advanced Photonics.

[32]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.

[33]  Gabriel Popescu,et al.  Effects of spatial coherence in diffraction phase microscopy. , 2014, Optics express.

[34]  R. Dasari,et al.  Diffraction phase microscopy for quantifying cell structure and dynamics. , 2006, Optics letters.

[35]  Bahram Javidi,et al.  Noise-free quantitative phase imaging in Gabor holography with conditional generative adversarial network. , 2020, Optics express.

[36]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[37]  Kaikai Guo,et al.  Rapid focus map surveying for whole slide imaging with continues sample motion , 2017, Optics letters.

[38]  Tan H. Nguyen,et al.  Diffraction phase microscopy: principles and applications in materials and life sciences , 2014 .

[39]  Christian Depeursinge,et al.  Quantitative phase imaging in biomedicine , 2018, Nature Photonics.

[40]  Li Xi,et al.  Autofocusing of ISAR images based on entropy minimization , 1999 .

[41]  Qinghua Hu,et al.  Progressive Image Deraining Networks: A Better and Simpler Baseline , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[43]  Aydogan Ozcan,et al.  Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning , 2019, Nature Methods.