Numerical dark-field imaging using deep-learning.

Dark-field microscopy is a powerful technique for enhancing the imaging resolution and contrast of small unstained samples. In this study, we report a method based on end-to-end convolutional neural network to reconstruct high-resolution dark-field images from low-resolution bright-field images. The relation between bright- and dark-field which was difficult to deduce theoretically can be obtained by training the corresponding network. The training data, namely the matched bright- and dark-field images of the same object view, are simultaneously obtained by a special designed multiplexed image system. Since the image registration work which is the key step in data preparation is not needed, the manual error can be largely avoided. After training, a high-resolution numerical dark-field image is generated from a conventional bright-field image as the input of this network. We validated the method by the resolution test target and quantitative analysis of the reconstructed numerical dark-field images of biological tissues. The experimental results show that the proposed learning-based method can realize the conversion from bright-field image to dark-field image, so that can efficiently achieve high-resolution numerical dark-field imaging. The proposed network is universal for different kinds of samples. In addition, we also verify that the proposed method has good anti-noise performance and is not affected by the unstable factors caused by experiment setup.

[1]  Shigeo Kubota,et al.  Very efficient speckle contrast reduction realized by moving diffuser device. , 2010, Applied optics.

[2]  C. Fang-Yen,et al.  Optical diffraction tomography for high resolution live cell imaging. , 2009, Optics express.

[3]  Chunqing Gao,et al.  Perfect optical vortex array with controllable diffraction order and topological charge. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Jörg Piper,et al.  Variable bright‐darkfield‐contrast, a new illumination technique for improved visualizations of complex structured transparent specimens , 2012, Microscopy research and technique.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Changhuei Yang,et al.  Microscopy refocusing and dark-field imaging by using a simple LED array. , 2011, Optics letters.

[7]  Tomer Michaeli,et al.  Deep-STORM: super-resolution single-molecule microscopy by deep learning , 2018, 1801.09631.

[8]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[9]  Leslie Rusch,et al.  Perfect vortex beam: Fourier transformation of a Bessel beam. , 2015, Optics letters.

[10]  Nicolas Lemercier,et al.  Transmission Microsphere‐Assisted Dark‐Field Microscopy , 2018, physica status solidi (RRL) - Rapid Research Letters.

[11]  Ming Lei,et al.  Multifunctional darkfield microscopy using an axicon. , 2008, Journal of biomedical optics.

[12]  W. A. Cook,et al.  Incident Dark-Field Illumination: a New Method for Microcirculatory Study , 1971, Angiology.

[13]  Laura Waller,et al.  Real-time brightfield, darkfield, and phase contrast imaging in a light-emitting diode array microscope , 2014, Journal of biomedical optics.

[14]  Wolfgang Osten,et al.  Opposed-view dark-field digital holographic microscopy. , 2014, Biomedical optics express.

[15]  Giancarlo Pedrini,et al.  High-contrast multilayer imaging of biological organisms through dark-field digital refocusing , 2013, Journal of biomedical optics.

[16]  Yuping Tai,et al.  Controllable mode transformation in perfect optical vortices. , 2018, Optics express.

[17]  Hongchen Zhai,et al.  Angular multiplexing in pulsed digital holography for aperture synthesis. , 2008, Optics letters.

[18]  Dinggang Shen,et al.  Scalable High-Performance Image Registration Framework by Unsupervised Deep Feature Representations Learning , 2016, IEEE Transactions on Biomedical Engineering.

[19]  A. Ozcan,et al.  Deep learning in holography and coherent imaging , 2019, Light: Science & Applications.

[20]  Can Ince,et al.  Cytocam-IDF (incident dark field illumination) imaging for bedside monitoring of the microcirculation , 2015, Intensive Care Medicine Experimental.

[21]  Lihong V. Wang,et al.  In vivo dark-field reflection-mode photoacoustic microscopy. , 2005, Optics letters.

[22]  Yibo Zhang,et al.  PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning , 2018, Light: Science & Applications.

[23]  Christoph K. Hitzenberger,et al.  Beyond backscattering: optical neuroimaging by BRAD , 2017, Biomedical optics express.

[24]  Lei Tian,et al.  Deep learning approach for Fourier ptychography microscopy. , 2018, Optics express.

[25]  K. Aït-Ameur,et al.  Gaussian beam conversion using an axicon , 1999 .

[26]  S. Pennycook,et al.  Atom-by-atom structural and chemical analysis by annular dark-field electron microscopy , 2010, Nature.

[27]  E. Wolf Three-dimensional structure determination of semi-transparent objects from holographic data , 1969 .

[28]  Wolfgang Osten,et al.  Recent advances in digital holography [invited]. , 2014, Applied optics.

[29]  Vicente Micó,et al.  DarkFocus: numerical autofocusing in digital in-line holographic microscopy using variance of computational dark-field gradient , 2020, Optics and Lasers in Engineering.

[30]  Yangjian Cai,et al.  Grafted optical vortex with controllable orbital angular momentum distribution. , 2019, Optics express.

[31]  Carlos Trujillo,et al.  Numerical dark field illumination applied to experimental digital lensless holographic microscopy for reconstructions with enhanced contrast. , 2018, Optics letters.

[32]  Aydogan Ozcan,et al.  Resolution enhancement in scanning electron microscopy using deep learning , 2019, Scientific Reports.

[33]  Fenqiang Zhao,et al.  Deep learning enables structured illumination microscopy with low light levels and enhanced speed , 2020, Nature Communications.

[34]  A Finizio,et al.  Whole optical wavefields reconstruction by digital holography. , 2001, Optics express.

[35]  Wolfgang Osten,et al.  Resolution improvement in digital holography by angular and polarization multiplexing. , 2011, Applied optics.

[36]  Jing Zhang,et al.  Surface-plasmon microscopy with a two-piece solid immersion lens: bright and dark fields. , 2006, Applied optics.

[37]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[38]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[39]  Yibo Zhang,et al.  Phase recovery and holographic image reconstruction using deep learning in neural networks , 2017, Light: Science & Applications.