Smart-phone phase contrast microscope with a singlet lens and deep learning

Abstract Amounts of cost-effective biological observing and detecting instruments are needed in biology and medical applications. In these demands, a low-cost, portable microscope with light-weight and tele-communication, is very attractive in the resource-limit area. In this manuscript, a portable singlet phase contrast microscope based on smart-phones are proposed. In the optics hardware, an external singlet lens is designed and closely attached before the rear cameras of a smart-phone, which constructs the imaging part of a simplified microscope. And a circular oblique illumination is adopted. In the computational imaging part, the in-focus images recorded by the smart-phone are virtually enhanced and style-transferred to phase contrast images by deep learning methods. Through pairs of experimental image data, we train the deep learning network and demonstrate the effectiveness of this virtual phase contrast imaging approach using multiple samples, e.g., unstained/transparent tumor tissue pathological slide, and H&E (Hematoxylin and Eosin) stained tumor tissue pathological slide. Our results provide a powerful example of low-cost portable phase contrast microscope with high-speed tele-communication abilities in the 5G + mobile internet era.

[1]  Young-Gu Ju,et al.  A smartphone-based fluorescence microscope utilizing an external phone camera lens module , 2015, BioChip Journal.

[2]  Ni Zhao,et al.  Portable quantitative phase microscope for material metrology and biological imaging , 2020 .

[3]  Mobile phone and handheld microscopes for public health applications. , 2017, The Lancet. Public health.

[4]  Ashish Kapoor,et al.  Blood Count on a Smartphone Microscope: Challenges , 2017, HotMobile.

[5]  Aydogan Ozcan,et al.  Mobile phones create new opportunities for microbiology research and clinical applications. , 2017, Future microbiology.

[6]  Kutay Icoz Image Processing and Cell Phone Microscopy to Analyze the Immunomagnetic Beads on Micro-Contact Printed Gratings , 2016 .

[7]  Aydogan Ozcan,et al.  Emerging Advances to Transform Histopathology Using Virtual Staining , 2020, BME frontiers.

[8]  Ronald P. Rapini,et al.  A Comparative Study Between Smartphone-Based Microscopy and Conventional Light Microscopy in 1021 Dermatopathology Specimens. , 2016 .

[9]  A. Ozcan,et al.  Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning , 2018, Nature Biomedical Engineering.

[10]  Yibo Zhang,et al.  PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning , 2018, Light: Science & Applications.

[11]  Wataru Watanabe,et al.  Mobile-phone-based Rheinberg microscope with a light-emitting diode array , 2018, Journal of biomedical optics.

[12]  Rafael G. González-Acuña,et al.  General formula for bi-aspheric singlet lens design free of spherical aberration. , 2018, Applied optics.

[13]  Austin Todd,et al.  Slide-free MUSE Microscopy to H&E Histology Modality Conversion via Unpaired Image-to-Image Translation GAN Models , 2020, ArXiv.

[14]  Jie Tian,et al.  Multiscale imaging of colitis in mice using confocal laser endomicroscopy, light-sheet fluorescence microscopy, and magnetic resonance imaging , 2019, Journal of biomedical optics.

[15]  Huaxia Shen,et al.  Portable deep learning singlet microscope , 2020, Journal of biophotonics.

[16]  Yifan Peng,et al.  Learned large field-of-view imaging with thin-plate optics , 2019, ACM Trans. Graph..

[17]  Colin J R Sheppard,et al.  Partially coherent image formation in differential interference contrast (DIC) microscope. , 2008, Optics express.

[18]  Nassir Navab,et al.  Staingan: Stain Style Transfer for Digital Histological Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[19]  Tanguy Thibert,et al.  Flat Fresnel doublets made of PMMA and PC: combining low cost production and very high concentration ratio for CPV. , 2011, Optics express.

[20]  Gordon Wetzstein,et al.  Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging , 2020 .

[21]  L. Tian,et al.  Optimal illumination scheme for isotropic quantitative differential phase contrast microscopy , 2019, Photonics Research.

[22]  Ming Lei,et al.  Subwavelength resolution Fourier ptychography with hemispherical digital condensers. , 2018, Optics express.

[23]  Jiantai Dou,et al.  Sequential Shift Absolute Phase Aberration Calibration in Digital Holographic Phase Imaging Based on Chebyshev Polynomials Fitting , 2020, IEEE Photonics Journal.

[24]  R. Duncan,et al.  EnLightenment: High resolution smartphone microscopy as an educational and public engagement platform [version 1; referees: 2 approved] , 2017 .

[25]  B C Gibson,et al.  A dual-mode mobile phone microscope using the onboard camera flash and ambient light , 2018, Scientific Reports.

[26]  An Pan,et al.  Vignetting effect in Fourier ptychographic microscopy , 2019, Optics and Lasers in Engineering.

[27]  Konstantinos N. Plataniotis,et al.  Stain Style Transfer of Histopathology Images Via Structure-Preserved Generative Learning , 2020, MLMIR@MICCAI.

[28]  Baoli Yao,et al.  High-resolution and large field-of-view Fourier ptychographic microscopy and its applications in biomedicine , 2020, Reports on progress in physics. Physical Society.

[29]  Vishal Srivastava,et al.  Deep learning enabled multi-wavelength spatial coherence microscope for the classification of malaria-infected stages with limited labelled data size , 2019, ArXiv.

[30]  Yibo Zhang,et al.  Demosaiced pixel super-resolution for multiplexed holographic color imaging , 2016, Scientific Reports.

[31]  Jinlong Zhu,et al.  Regularized pseudo-phase imaging for inspecting and sensing nanoscale features. , 2019, Optics express.

[32]  J. Thiran,et al.  Structure Preserving Stain Normalization of Histopathology Images Using Self-Supervised Semantic Guidance , 2020, MICCAI.

[33]  Alexander Jesacher,et al.  Phase contrast microscopy with full numerical aperture illumination. , 2008, Optics express.

[34]  Ruck Thawonmas,et al.  Image Colorization Using a Deep Convolutional Neural Network , 2016, ArXiv.

[35]  Harald Haas,et al.  Gb/s Underwater Wireless Optical Communications Using Series-Connected GaN Micro-LED Arrays , 2020, IEEE Photonics Journal.

[36]  Zhishan Gao,et al.  Phase retrieval based on pupil scanning modulation , 2017, Applied Physics B.

[37]  Douglas H. Werner,et al.  Apochromatic singlets enabled by metasurface-augmented GRIN lenses , 2018 .

[38]  Din Ping Tsai,et al.  Spectral tomographic imaging with aplanatic metalens , 2019, Light: Science & Applications.

[39]  Sang Joon Lee,et al.  Deep learning-based digital in-line holographic microscopy for high resolution with extended field of view , 2019, Optics & Laser Technology.

[40]  A. Wood,et al.  Infrared imaging with a wavefront-coded singlet lens. , 2009, Optics express.

[41]  Compact Fluorescence Microscope for Smartphone and Tablet , 2018 .