Second Harmonic Imaging Enhanced by Deep Learning Decipher

Wavefront sensing and reconstruction are widely used for adaptive optics, aberration correction, and high-resolution optical phase imaging. Traditionally, interference and/or microlens arrays are used to convert the optical phase into intensity variation. Direct imaging of distorted wavefront usually results in complicated phase retrieval with low contrast and low sensitivity. Here, a novel approach has been developed and experimentally demonstrated based on the phase-sensitive information encoded into second harmonic signals, which are intrinsically sensitive to wavefront modulations. By designing and implementing a deep neural network, we demonstrate the second harmonic imaging enhanced by deep learning decipher (SHIELD) for efficient and resilient phase retrieval. Inheriting the advantages of two-photon microscopy, SHIELD demonstrates single-shot, reference-free, and video-rate phase imaging with sensitivity better than {\lambda}/100 and high robustness against noises, facilitating numerous applications from biological imaging to wavefront sensing.

[1]  Alan H. Greenaway,et al.  Wavefront sensing: From historical roots to the state-of-the-art , 2006 .

[2]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ohad Shamir,et al.  The Power of Depth for Feedforward Neural Networks , 2015, COLT.

[4]  Anthony E. Siegman,et al.  Nonlinear-optical calculations using fast-transform methods: Second-harmonic generation with depletion and diffraction , 1980 .

[5]  I. Yamaguchi,et al.  Phase-shifting digital holography. , 1997, Optics letters.

[6]  Gunnar Arisholm,et al.  General numerical methods for simulating second-order nonlinear interactions in birefringent media , 1997 .

[7]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[8]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[9]  Manoj Kumar Sharma,et al.  WISH: wavefront imaging sensor with high resolution , 2019, Light: Science & Applications.

[10]  Martin M. Fejer,et al.  Ultrahigh-efficiency wavelength conversion in nanophotonic periodically poled lithium niobate waveguides , 2018, Optica.

[11]  Barry R. Masters,et al.  Quantitative Phase Imaging of Cells and Tissues , 2012 .

[12]  Eric Betzig,et al.  Adaptive optics via pupil segmentation for high-resolution imaging in biological tissues , 2010, Nature Methods.

[13]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[14]  J. Řeháček,et al.  Wavefront sensing reveals optical coherence , 2014, Nature Communications.

[15]  Martin J. Booth,et al.  Adaptive optical microscopy: the ongoing quest for a perfect image , 2014, Light: Science & Applications.

[16]  Yibo Zhang,et al.  Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery , 2018, Optica.

[17]  Francesco Renna,et al.  On instabilities of deep learning in image reconstruction and the potential costs of AI , 2019, Proceedings of the National Academy of Sciences.

[18]  Vladislav V. Yakovlev,et al.  Enhanced Second Harmonic Generation Efficiency via Wavefront Shaping , 2017 .

[19]  F. Zernike Phase contrast, a new method for the microscopic observation of transparent objects , 1942 .

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  K Nemoto,et al.  Second-harmonic generation and wave-front correction of a terawatt laser system. , 2000, Optics letters.

[22]  R. Shack,et al.  History and principles of Shack-Hartmann wavefront sensing. , 2001, Journal of refractive surgery.

[23]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[24]  C. Depeursinge,et al.  Quantitative phase imaging in biomedicine , 2012, 2012 Conference on Lasers and Electro-Optics (CLEO).

[25]  Ady Arie,et al.  Dynamic control of light beams in second harmonic generation. , 2015, Optics letters.

[26]  Kevin J Webb,et al.  Imaging optical fields through heavily scattering media. , 2014, Physical review letters.

[27]  L. Tian,et al.  3D intensity and phase imaging from light field measurements in an LED array microscope , 2015 .

[28]  E. Cuche,et al.  Digital holography for quantitative phase-contrast imaging. , 1999, Optics letters.

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.