Richardson-Lucy deconvolution as a general tool for combining images with complementary strengths.

We use Richardson-Lucy (RL) deconvolution to combine multiple images of a simulated object into a single image in the context of modern fluorescence microscopy techniques. RL deconvolution can merge images with very different point-spread functions, such as in multiview light-sheet microscopes,1, 2 while preserving the best resolution information present in each image. We show that RL deconvolution is also easily applied to merge high-resolution, high-noise images with low-resolution, low-noise images, relevant when complementing conventional microscopy with localization microscopy. We also use RL deconvolution to merge images produced by different simulated illumination patterns, relevant to structured illumination microscopy (SIM)3, 4 and image scanning microscopy (ISM). The quality of our ISM reconstructions is at least as good as reconstructions using standard inversion algorithms for ISM data, but our method follows a simpler recipe that requires no mathematical insight. Finally, we apply RL deconvolution to merge a series of ten images with varying signal and resolution levels. This combination is relevant to gated stimulated-emission depletion (STED) microscopy, and shows that merges of high-quality images are possible even in cases for which a non-iterative inversion algorithm is unknown.

[1]  P. Jansson Deconvolution of images and spectra , 1997 .

[2]  E. LESTER SMITH,et al.  AND OTHERS , 2005 .

[3]  M. Bertero,et al.  Image deblurring with Poisson data: from cells to galaxies , 2009 .

[4]  Jan Huisken,et al.  Multi-view image fusion improves resolution in three-dimensional microscopy. , 2007, Optics express.

[5]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[6]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[7]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[8]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[9]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[10]  Hari Shroff,et al.  Resolution Doubling in Live, Multicellular Organisms via Multifocal Structured Illumination Microscopy , 2012, Nature Methods.

[11]  Justin Senseney,et al.  Spatially isotropic four-dimensional imaging with dual-view plane illumination microscopy , 2013, Nature Biotechnology.

[12]  Thomas Brox,et al.  Multiview Deblurring for 3-D Images from Light-Sheet-Based Fluorescence Microscopy , 2012, IEEE Transactions on Image Processing.

[13]  C Cremer,et al.  Axial tomographic confocal fluorescence microscopy , 2002, Journal of microscopy.

[14]  T M Jovin,et al.  Improved restoration from multiple images of a single object: application to fluorescence microscopy. , 1998, Applied optics.

[15]  Jörg Enderlein,et al.  Image scanning microscopy. , 2010, Physical review letters.

[16]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[17]  S. Hell,et al.  Sharper low-power STED nanoscopy by time gating , 2011, Nature Methods.