Modeling Point Spread Function in Fluorescence Microscopy With a Sparse Gaussian Mixture: Tradeoff Between Accuracy and Efficiency

Deblurring is a fundamental inverse problem in bioimaging. It requires modeling the point spread function (PSF), which captures the optical distortions entailed by the image formation process. The PSF limits the spatial resolution attainable for a given microscope. However, recent applications require a higher resolution and have prompted the development of super-resolution techniques to achieve sub-pixel accuracy. This requirement restricts the class of suitable PSF models to analog ones. In addition, deblurring is computationally intensive, hence further requiring computationally efficient models. A custom candidate fitting both the requirements is the Gaussian model. However, this model cannot capture the rich tail structures found in both the theoretical and empirical PSFs. In this paper, we aim at improving the reconstruction accuracy beyond the Gaussian model, while preserving its computational efficiency. We introduce a new class of analog PSF models based on the Gaussian mixtures. The number of Gaussian kernels controls both the modeling accuracy and the computational efficiency of the model: the lower the number of kernels, the lower the accuracy and the higher the efficiency. To explore the accuracy-efficiency tradeoff, we propose a variational formulation of the PSF calibration problem, where a convex sparsity-inducing penalty on the number of Gaussian kernels allows trading accuracy for efficiency. We derive an efficient algorithm based on a fully split formulation of alternating split Bregman. We assess our framework on synthetic and real data, and demonstrate a better reconstruction accuracy in both geometry and photometry in point source localization—a fundamental inverse problem in fluorescence microscopy.

[1]  R. Juškaitis Measuring the Real Point Spread Function of High Numerical Aperture Microscope Objective Lenses , 2006 .

[2]  Stéphane Canu,et al.  Recovering Sparse Signals With a Certain Family of Nonconvex Penalties and DC Programming , 2009, IEEE Transactions on Signal Processing.

[3]  Chrysanthe Preza,et al.  Fluorescence microscopy point spread function model accounting for aberrations due to refractive index variability within a specimen , 2015, Journal of biomedical optics.

[4]  Michael P. Hobson,et al.  A Stochastic Model for Electron Multiplication Charge-Coupled Devices – From Theory to Practice , 2013, PloS one.

[5]  D A Agard,et al.  Dispersion, aberration and deconvolution in multi‐wavelength fluorescence images , 1996, Journal of microscopy.

[6]  D. Rawlins,et al.  The point‐spread function of a confocal microscope: its measurement and use in deconvolution of 3‐D data , 1991 .

[7]  François Aguet,et al.  Super-resolution fluorescence microscopy based on physical models , 2009 .

[8]  D. Agard,et al.  Fluorescence microscopy in three dimensions. , 1989, Methods in cell biology.

[9]  A. Small,et al.  Fluorophore localization algorithms for super-resolution microscopy , 2014, Nature Methods.

[10]  D. Agard,et al.  Determination of three-dimensional imaging properties of a light microscope system. Partial confocal behavior in epifluorescence microscopy. , 1990, Biophysical journal.

[11]  J Boutet de Monvel,et al.  Image restoration for confocal microscopy: improving the limits of deconvolution, with application to the visualization of the mammalian hearing organ. , 2001, Biophysical journal.

[12]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[13]  Rob J Hyndman,et al.  Computing and Graphing Highest Density Regions , 1996 .

[14]  J. Sibarita Deconvolution microscopy. , 2005, Advances in biochemical engineering/biotechnology.

[15]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[16]  Bruno Colicchio,et al.  Identification of acquisition parameters from the point spread function of a fluorescence microscope , 2001 .

[17]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[18]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[19]  Mats Ulfendahl,et al.  Image-adaptive deconvolution for three-dimensional deep biological imaging. , 2003, Biophysical journal.

[20]  Josiane Zerubia,et al.  Point-Spread Function retrieval for fluorescence microscopy , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Larry S. Davis,et al.  Improved fast gauss transform and efficient kernel density estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Le Thi Hoai An,et al.  DC approximation approaches for sparse optimization , 2014, Eur. J. Oper. Res..

[23]  S. Hell,et al.  Aberrations in confocal fluorescence microscopy induced by mismatches in refractive index , 1993 .

[24]  Jean-Marie Becker,et al.  Fast Approximations of Shift-Variant Blur , 2015, International Journal of Computer Vision.

[25]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[26]  Ivo F. Sbalzarini,et al.  Coupling Image Restoration and Segmentation: A Generalized Linear Model/Bregman Perspective , 2013, International Journal of Computer Vision.

[27]  P. Varga,et al.  Electromagnetic diffraction of light focused through a stratified medium. , 1997, Applied optics.

[28]  Ferréol Soulez,et al.  Spatially variant PSF modeling and image deblurring , 2016, Astronomical Telescopes + Instrumentation.

[29]  Gabriele Steidl,et al.  Deblurring Poissonian images by split Bregman techniques , 2010, J. Vis. Commun. Image Represent..

[30]  J. Conchello,et al.  Three-dimensional imaging by deconvolution microscopy. , 1999, Methods.

[31]  Michael Unser,et al.  Models for Fluorescence Microscopy in ImageJ , 2011 .

[32]  Gábor Székely,et al.  Mapping complex spatio-temporal models to image space: The virtual microscope , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[33]  Josiane Zerubia,et al.  Blind deconvolution for thin-layered confocal imaging. , 2009, Applied optics.

[34]  Mikhail V. Konnik,et al.  High-level numerical simulations of noise in CCD and CMOS photosensors: review and tutorial , 2014, ArXiv.

[35]  A. Dieterlen,et al.  Fluorescence microscopy three-dimensional depth variant point spread function interpolation using Zernike moments , 2011 .

[36]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  N. Bissantz,et al.  Improving PSF calibration in confocal microscopic imaging—estimating and exploiting bilateral symmetry , 2010, 1102.0630.

[38]  Larry S. Davis,et al.  Automatic online tuning for fast Gaussian summation , 2008, NIPS.

[39]  Michael Unser,et al.  Can localization microscopy benefit from approximation theory? , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[40]  Olivier Haeberlé,et al.  Focusing of light through a stratified medium: a practical approach for computing microscope point spread functions: Part II: confocal and multiphoton microscopy , 2004 .

[41]  M. Gustafsson,et al.  Phase‐retrieved pupil functions in wide‐field fluorescence microscopy , 2004, Journal of microscopy.

[42]  L. J. Thomas,et al.  Artifacts in computational optical-sectioning microscopy. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  S. Gibson,et al.  Experimental test of an analytical model of aberration in an oil-immersion objective lens used in three-dimensional light microscopy. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[44]  Nicolas Papadakis,et al.  On Debiasing Restoration Algorithms: Applications to Total-Variation and Nonlocal-Means , 2015, SSVM.

[45]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[46]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[47]  Gilles Aubert,et al.  Blind restoration of confocal microscopy images in presence of a depth-variant blur and Poisson noise , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[48]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[49]  Joshua W Shaevitz,et al.  Enhanced three-dimensional deconvolution microscopy using a measured depth-varying point-spread function. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[50]  E Sally Ward,et al.  Determination of localization accuracy based on experimentally acquired image sets: applications to single molecule microscopy. , 2015, Optics express.