Artifact-free deconvolution in light field microscopy.

The sampling patterns of the light field microscope (LFM) are highly depth-dependent, which implies non-uniform recoverable lateral resolution across depth. Moreover, reconstructions using state-of-the-art approaches suffer from strong artifacts at axial ranges, where the LFM samples the light field at a coarse rate. In this work, we analyze the sampling patterns of the LFM, and introduce a flexible light field point spread function model (LFPSF) to cope with arbitrary LFM designs. We then propose a novel aliasing-aware deconvolution scheme to address the sampling artifacts. We demonstrate the high potential of the proposed method on real experimental data.

[1]  E. Boyden,et al.  Simultaneous whole-animal 3D-imaging of neuronal activity using light-field microscopy , 2014, Nature Methods.

[2]  M. Levoy,et al.  Recording and controlling the 4D light field in a microscope using microlens arrays , 2009, Journal of microscopy.

[3]  Aaron S. Andalman,et al.  Enhancing the performance of the light field microscope using wavefront coding. , 2014, Optics express.

[4]  Zeguan Wang,et al.  Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (Danio rerio) , 2017, bioRxiv.

[5]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[6]  Michael C Roggemann,et al.  Digital simulation of scalar optical diffraction: revisiting chirp function sampling criteria and consequences. , 2009, Applied optics.

[7]  Haoyu Li,et al.  Fast, volumetric live-cell imaging using high-resolution light-field microscopy. , 2019, Biomedical optics express.

[8]  Nils Wagner,et al.  Instantaneous isotropic volumetric imaging of fast biological processes , 2019, Nature Methods.

[9]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[11]  M. Levoy,et al.  Light field microscopy , 2006, SIGGRAPH 2006.

[12]  Li-Yi Wei,et al.  Improving light field camera sample design with irregularity and aberration , 2015, ACM Trans. Graph..

[13]  Andrew Lumsdaine,et al.  The multifocus plenoptic camera , 2011, Electronic Imaging.

[14]  Sven Wanner,et al.  Variational Light Field Analysis for Disparity Estimation and Super-Resolution , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  George Wolberg,et al.  Sampling, Reconstruction, and Antialiasing , 1997, The Computer Science and Engineering Handbook.

[16]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[17]  Frédo Durand,et al.  4D frequency analysis of computational cameras for depth of field extension , 2009, SIGGRAPH 2009.

[18]  Paolo Favaro,et al.  A split-sensor light field camera for extended depth of field and superresolution , 2012, Photonics Europe.

[19]  Sehoon Ha,et al.  Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques , 2014, ACM Trans. Graph..

[20]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[21]  Ravi Ramamoorthi,et al.  A Light Transport Framework for Lenslet Light Field Cameras , 2015, TOGS.

[22]  Kathrin Berkner,et al.  Image formation analysis and high resolution image reconstruction for plenoptic imaging systems. , 2013, Applied optics.

[23]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[24]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[25]  G. Lippmann Epreuves reversibles donnant la sensation du relief , 1908 .

[26]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  J. Fleischer,et al.  High-Resolution Light-Field Microscopy , 2013 .

[28]  Pascal Frossard,et al.  Geometry-Consistent Light Field Super-Resolution via Graph-Based Regularization , 2017, IEEE Transactions on Image Processing.

[29]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .