Computational multifocal microscopy

Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope," in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits optical elements for correcting chromatic aberrations and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope. The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve spatial resolutions of 0.35um (lateral) and 0.5um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at 25 frames per second using our proposed computational multifocal microscopy technique.

[1]  M. Laasmaa,et al.  Application of regularized Richardson–Lucy algorithm for deconvolution of confocal microscopy images , 2011, Journal of microscopy.

[2]  Pablo Ruiz,et al.  Design and simulation of a snapshot multi-focal interferometric microscope. , 2018, Optics express.

[3]  Aggelos K. Katsaggelos,et al.  4D tracking of biological samples using lens-free on-chip in-line holography , 2016 .

[4]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[5]  C. Ruckebusch,et al.  Improved superresolution microscopy imaging by sparse deconvolution with an interframe penalty , 2017 .

[6]  Alexander Y Katsov,et al.  fast multicolor 3 d imaging using aberration-corrected multifocus microscopy , 2012 .

[7]  Brian P. Mehl,et al.  Multifocus microscopy with precise color multi-phase diffractive optics applied in functional neuronal imaging. , 2016, Biomedical optics express.

[8]  E. Boyden,et al.  Simultaneous whole-animal 3D-imaging of neuronal activity using light-field microscopy , 2014, Nature Methods.

[9]  Yonina C. Eldar,et al.  Sparsity-based single-shot sub-wavelength coherent diffractive imaging , 2011, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[10]  Joseph A Izatt,et al.  Structured illumination microscopy for dual-modality 3D sub-diffraction resolution fluorescence and refractive-index reconstruction. , 2017, Biomedical optics express.

[11]  Josiane Zerubia,et al.  Richardson–Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution , 2006, Microscopy research and technique.

[12]  Joseph Rosen,et al.  Digital spatially incoherent Fresnel holography. , 2007, Optics letters.

[13]  L. Tian,et al.  3D differential phase-contrast microscopy with computational illumination using an LED array. , 2014, Optics letters.

[14]  P. Eilers,et al.  Sparse deconvolution of high-density super-resolution images , 2016, Scientific Reports.

[15]  Aggelos K. Katsaggelos,et al.  Dictionary-based phase retrieval for space-time super resolution using lens-free on-chip holographic video , 2017 .

[16]  Laura Waller,et al.  Multiplexed phase-space imaging for 3D fluorescence microscopy. , 2017, Optics express.

[17]  Joseph Rosen,et al.  Non-scanning motionless fluorescence three-dimensional holographic microscopy , 2008 .

[18]  Aggelos K. Katsaggelos,et al.  Compressive Holographic Video , 2016, Optics express.

[19]  Aggelos K. Katsaggelos,et al.  Compressive reconstruction for 3D incoherent holographic microscopy , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[20]  A H Greenaway,et al.  Simultaneous multiplane imaging with a distorted diffraction grating. , 1999, Applied optics.

[21]  Nicolas C. Pégard,et al.  Compressive light-field microscopy for 3D neural activity recording , 2016 .

[22]  Laura Waller,et al.  DiffuserCam: Lensless Single-exposure 3D Imaging , 2017, ArXiv.

[23]  G. Pedrini,et al.  Short coherence digital holography for 3D microscopy , 2001 .

[24]  Joseph N. Mait,et al.  Understanding diffractive optical design in the scalar domain , 1995, OSA Annual Meeting.

[25]  P. Green On Use of the EM Algorithm for Penalized Likelihood Estimation , 1990 .

[26]  G. Indebetouw,et al.  Three-dimensional holographic fluorescence microscopy. , 1997, Optics letters.

[27]  Ashok Veeraraghavan,et al.  Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope , 2017, Science Advances.

[28]  Aydogan Ozcan,et al.  Lensless wide-field fluorescent imaging on a chip using compressive decoding of sparse objects , 2010, Optics express.

[29]  L. Tian,et al.  3D intensity and phase imaging from light field measurements in an LED array microscope , 2015 .

[30]  O REN S OLOMON,et al.  Sparsity-based super-resolution microscopy from correlation information , 2018 .

[31]  Laurent Mazenq,et al.  Astigmatic multifocus microscopy enables deep 3D super-resolved imaging. , 2016, Biomedical optics express.

[32]  Guoan Zheng,et al.  Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video. , 2017, Biomedical optics express.