Digital refocusing and extended depth of field reconstruction in Fourier ptychographic microscopy

Fourier ptychography microscopy (FPM) is a recently developed microscopic imaging method that allows the recovery of a high-resolution complex image by combining a sequence of bright and darkfield images acquired under inclined illumination. The capacity of FPM for high resolution imaging at low magnification makes it particularly attractive for applications in digital pathology which require imaging of large specimens such as tissue sections and blood films. To date most applications of FPM have been limited to imaging thin samples, simplifying both image reconstruction and analysis. In this work we show that, for samples of intermediate thickness (defined here as less than the depth of field of a raw captured image), numerical propagation of the reconstructed complex field allows effective digital refocusing of FPM images. The results are validated by comparison against images obtained with an equivalent high numerical aperture objective lens. We find that post reconstruction refocusing (PRR) yields images comparable in quality to adding a defocus term to the pupil function within the reconstruction algorithm, while reducing computing time by several orders of magnitude. We apply PRR to visualize FPM images of Giemsa-stained peripheral blood films and present a novel image processing pipeline to construct an effective extended depth of field image which optimally displays the 3D sample structure in a 2D image. We also show how digital refocusing allows effective correction of the chromatic focus shifts inherent to the low magnification objective lenses used in FPM setups, improving the overall quality of color FPM images.

[1]  O. Haeberlé,et al.  Holographic microscopy and diffractive microtomography of transparent samples , 2008 .

[2]  Chao Zuo,et al.  High-speed Fourier ptychographic microscopy based on programmable annular illuminations , 2018, Scientific Reports.

[3]  Alessandro Bevilacqua,et al.  Extended depth of focus in optical microscopy: Assessment of existing methods and a new proposal , 2012, Microscopy research and technique.

[4]  Jizhou Zhang,et al.  Fourier ptychographic microscopy reconstruction with multiscale deep residual network. , 2019, Optics express.

[5]  M. E. Cox Handbook of Optics , 1980 .

[6]  Michael Unser,et al.  Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images , 2004, Microscopy research and technique.

[7]  José M. Bioucas-Dias,et al.  Phase Unwrapping via Graph Cuts , 2005, IEEE Transactions on Image Processing.

[8]  R. Horstmeyer,et al.  Wide-field, high-resolution Fourier ptychographic microscopy , 2013, Nature Photonics.

[9]  Changhuei Yang,et al.  Counting White Blood Cells from a Blood Smear Using Fourier Ptychographic Microscopy , 2015, PloS one.

[10]  Laura Waller,et al.  Computational illumination for high-speed in vitro Fourier ptychographic microscopy , 2015, 1506.04274.

[11]  R. Horstmeyer,et al.  High numerical aperture Fourier ptychography: principle, implementation and characterization. , 2015, Optics express.

[12]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[13]  Henry Pinkard,et al.  Advanced methods of microscope control using μManager software. , 2014, Journal of biological methods.

[14]  Kannan Ramchandran,et al.  Multiplexed coded illumination for Fourier Ptychography with an LED array microscope. , 2014, Biomedical optics express.

[15]  Laura Waller,et al.  High-resolution 3D refractive index microscopy of multiple-scattering samples from intensity images. , 2019, Optica.

[16]  R. Horstmeyer,et al.  Diffraction tomography with Fourier ptychography. , 2015, Optica.

[17]  Kaikai Guo,et al.  Fourier Ptychography for Brightfield, Phase, Darkfield, Reflective, Multi-Slice, and Fluorescence Imaging , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[18]  Laura Waller,et al.  Experimental robustness of Fourier Ptychography phase retrieval algorithms , 2015, Optics express.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  A G Valdecasas,et al.  On the extended depth of focus algorithms for bright field microscopy. , 2001, Micron.

[21]  Guoan Zheng,et al.  Embedded pupil function recovery for Fourier ptychographic microscopy. , 2014, Optics express.

[22]  L. Tian,et al.  3D intensity and phase imaging from light field measurements in an LED array microscope , 2015 .

[23]  Andrew R. Harvey,et al.  Low-cost, sub-micron resolution, wide-field computational microscopy using opensource hardware , 2018, Scientific Reports.