Wave optics theory and 3-D deconvolution for the light field microscope.

Light field microscopy is a new technique for high-speed volumetric imaging of weakly scattering or fluorescent specimens. It employs an array of microlenses to trade off spatial resolution against angular resolution, thereby allowing a 4-D light field to be captured using a single photographic exposure without the need for scanning. The recorded light field can then be used to computationally reconstruct a full volume. In this paper, we present an optical model for light field microscopy based on wave optics, instead of previously reported ray optics models. We also present a 3-D deconvolution method for light field microscopy that is able to reconstruct volumes at higher spatial resolution, and with better optical sectioning, than previously reported. To accomplish this, we take advantage of the dense spatio-angular sampling provided by a microlens array at axial positions away from the native object plane. This dense sampling permits us to decode aliasing present in the light field to reconstruct high-frequency information. We formulate our method as an inverse problem for reconstructing the 3-D volume, which we solve using a GPU-accelerated iterative algorithm. Theoretical limits on the depth-dependent lateral resolution of the reconstructed volumes are derived. We show that these limits are in good agreement with experimental results on a standard USAF 1951 resolution target. Finally, we present 3-D reconstructions of pollen grains that demonstrate the improvements in fidelity made possible by our method.

[1]  J. Goodman Introduction to Fourier optics , 1969 .

[2]  D. Agard Optical sectioning microscopy: cellular architecture in three dimensions. , 1984, Annual review of biophysics and bioengineering.

[3]  Colin J. R. Sheppard,et al.  Information capacity and resolution in an optical system , 1986 .

[4]  Mario Bertero,et al.  III Super-Resolution by Data Inversion , 1996 .

[5]  Stefan W. Hell,et al.  Equivalence of the Huygens–Fresnel and Debye approach for the calculation of high aperture point‐spread functions in the presence of refractive index mismatch , 1999 .

[6]  M. Gu,et al.  Advanced Optical Imaging Theory , 1999 .

[7]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  K. Gröchenig,et al.  Numerical and Theoretical Aspects of Nonuniform Sampling of Band-Limited Images , 2001 .

[9]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Colin J. R. Sheppard,et al.  A 3D vectorial optical transfer function suitable for arbitrary pupil functions , 2002 .

[11]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[12]  Klamer Schutte,et al.  Influence of signal-to-noise ratio and point spread function on limits of superresolution , 2005, IS&T/SPIE Electronic Imaging.

[13]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[14]  M. Levoy,et al.  Light field microscopy , 2006, SIGGRAPH 2006.

[15]  James G. Nagy,et al.  Covariance-Preconditioned Iterative Methods for Nonnegatively Constrained Astronomical Imaging , 2005, SIAM J. Matrix Anal. Appl..

[16]  Edmund Y. Lam,et al.  Super-resolution reconstruction in a computational compound-eye imaging system , 2007, Multidimens. Syst. Signal Process..

[17]  Rainer Heintzmann,et al.  Estimating missing information by maximum likelihood deconvolution. , 2007, Micron.

[18]  M. L E V O Y,et al.  Recording and controlling the 4 D light field in a microscope using microlens arrays , 2008 .

[19]  M. Bertero,et al.  Image deblurring with Poisson data: from cells to galaxies , 2009 .

[20]  M. Levoy,et al.  Recording and controlling the 4D light field in a microscope using microlens arrays , 2009, Journal of microscopy.

[21]  David George Voelz,et al.  Computational Fourier Optics: A MATLAB Tutorial , 2011 .

[22]  Joseph Rosen,et al.  Theoretical and experimental demonstration of resolution beyond the Rayleigh limit by FINCH fluorescence microscopic imaging. , 2011, Optics express.

[23]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[24]  Paolo Favaro,et al.  A split-sensor light field camera for extended depth of field and superresolution , 2012, Photonics Europe.

[25]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Alexander Y Katsov,et al.  fast multicolor 3 d imaging using aberration-corrected multifocus microscopy , 2012 .

[27]  J. Fleischer,et al.  High-Resolution Light-Field Microscopy , 2013 .

[28]  Kathrin Berkner,et al.  Image formation analysis and high resolution image reconstruction for plenoptic imaging systems. , 2013, Applied optics.

[29]  Bernard Muschielok,et al.  The 4MOST instrument concept overview , 2014, Astronomical Telescopes and Instrumentation.

[30]  Ammasi Periasamy,et al.  Advanced light microscopy. , 2014, Methods.