Learning Low-Dimensional Models of Microscopes

We propose original, accurate and computationally efficient procedures to calibrate fluorescence microscopes from micro-beads images. The designed algorithms present many singularities. First, they allow to estimate space-varying blurs, which is a critical feature for large fields of views. Second, we propose a novel approach for calibration: instead of describing an optical system through a single operator, we suggest to vary the imaging conditions (temperature, focus, active elements) to get indirect images of its different states. Our algorithms then allow to represent the microscope responses as a low-dimensional convex set of operators. This novel approach is shown to significantly improve the estimation on a wide-field microscope. It is deemed as an essential step towards the effective resolution of blind inverse problems. We illustrate the potential of the approach by designing an original procedure for blind image deblurring of point sources and show a massive improvement compared to commercial software.

[1]  Jay Anderson,et al.  Toward High‐Precision Astrometry with WFPC2. I. Deriving an Accurate Point‐Spread Function , 2000, astro-ph/0006325.

[2]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[3]  Chrysanthe Preza,et al.  Depth-variant maximum-likelihood restoration for three-dimensional fluorescence microscopy. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  S. Gibson,et al.  Diffraction by a circular aperture as a model for three-dimensional optical microscopy. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[5]  G. Meylan,et al.  Interpolating point spread function anisotropy , 2012, 1210.2696.

[6]  Jean-Marie Becker,et al.  Fast Approximations of Shift-Variant Blur , 2015, International Journal of Computer Vision.

[7]  Pierre Weiss,et al.  Estimation of linear operators from scattered impulse responses , 2016, Applied and Computational Harmonic Analysis.

[8]  Joshua W Shaevitz,et al.  Enhanced three-dimensional deconvolution microscopy using a measured depth-varying point-spread function. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[10]  C. Zimmer,et al.  ZOLA-3D allows flexible 3D localization microscopy over an adjustable axial range , 2018, Nature Communications.

[11]  T. Yan,et al.  Computational Correction of Spatially-Variant Optical Aberrations in 3D Single-Molecule Localization Microscopy , 2019, Biophysical Journal.

[12]  Vilma Jimenez Sabinina,et al.  Optimal 3D single-molecule localization in real time using experimental point spread functions , 2018, Nature Methods.

[13]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Pierre Weiss,et al.  Approximation of Integral Operators Using Product-Convolution Expansions , 2017, Journal of Mathematical Imaging and Vision.

[15]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..

[16]  Yue M. Lu,et al.  Decomposition of Space-Variant Blur in Image Deconvolution , 2016, IEEE Signal Processing Letters.

[17]  D. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4 / √ 3 , 2013 .

[18]  Jean-Luc Starck,et al.  Constraint matrix factorization for space variant PSFs field restoration , 2016, ArXiv.

[19]  John McGowan,et al.  A Parallel Product-Convolution approach for representing the depth varying Point Spread Functions in 3D widefield microscopy based on principal component analysis. , 2010, Optics express.

[20]  Ralf C Flicker,et al.  Anisoplanatic deconvolution of adaptive optics images. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Jean-Luc Starck,et al.  Super-resolution method using sparse regularization for point-spread function recovery , 2014, ArXiv.

[22]  Matthew D. Lew,et al.  Correcting field-dependent aberrations with nanoscale accuracy in three-dimensional single-molecule localization microscopy. , 2015, Optica.

[23]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[24]  A. Pinkus n-Widths in Approximation Theory , 1985 .

[25]  Vikas Sindhwani,et al.  Fast Conical Hull Algorithms for Near-separable Non-negative Matrix Factorization , 2012, ICML.

[26]  Nurmohammed Patwary,et al.  Image restoration for three-dimensional fluorescence microscopy using an orthonormal basis for efficient representation of depth-variant point-spread functions. , 2015, Biomedical optics express.

[27]  Michael Unser,et al.  DeconvolutionLab2: An open-source software for deconvolution microscopy. , 2017, Methods.

[28]  Guoan Zheng,et al.  Characterization of spatially varying aberrations for wide field-of-view microscopy. , 2013, Optics express.

[29]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[30]  Pierre Weiss,et al.  A scalable estimator of sets of integral operators , 2018, Inverse Problems.

[31]  John Strong,et al.  Principles of Optics . Electromagnetic theory of propagation, interference and diffraction of light. Max Born, Emil Wolf et al . Pergamon Press, New York, 1959. xxvi + 803 pp. Illus. $17.50 , 1960 .

[32]  Justin K. Romberg,et al.  Blind Deconvolution Using Convex Programming , 2012, IEEE Transactions on Information Theory.

[33]  Javier Portilla,et al.  Efficient shift-variant image restoration using deformable filtering (Part I) , 2012, EURASIP J. Adv. Signal Process..

[34]  René Henrion,et al.  On Properties of Different Notions of Centers for Convex Cones , 2010 .

[35]  J. Goodman Introduction to Fourier optics , 1969 .

[36]  Wolfgang Heidrich,et al.  High-quality computational imaging through simple lenses , 2013, TOGS.

[37]  M. Schmid Principles Of Optics Electromagnetic Theory Of Propagation Interference And Diffraction Of Light , 2016 .

[38]  Bernhard Schölkopf,et al.  Fast removal of non-uniform camera shake , 2011, 2011 International Conference on Computer Vision.