Structured Illumination Microscopy Image Reconstruction Algorithm

Structured illumination microscopy (SIM) is a very important super-resolution microscopy technique, which provides high speed super-resolution with about two-fold spatial resolution enhancement. Several attempts aimed at improving the performance of SIM reconstruction algorithm have been reported. However, most of these highlight only one specific aspect of the SIM reconstruction - such as the determination of the illumination pattern phase shift accurately - whereas other key elements - such as determination of modulation factor, estimation of object power spectrum, Wiener filtering frequency components with inclusion of object power spectrum information, translocating and the merging of the overlapping frequency components - are usually glossed over superficially. In addition, most of the study reported lie scattered throughout the literature and a comprehensive review of the theoretical background is found lacking. The purpose of the present study is two-fold: 1) to collect the essential theoretical details of SIM algorithm at one place, thereby making them readily accessible to readers for the first time; and 2) to provide an open source SIM reconstruction code (named OpenSIM), which enables users to interactively vary the code parameters and study it's effect on reconstructed SIM image.

[1]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[2]  Liang Gao QSIM: quantitative structured illumination microscopy image processing in ImageJ , 2015, Biomedical engineering online.

[3]  Hao Zhang,et al.  Fast Super-Resolution Imaging with Ultra-High Labeling Density Achieved by Joint Tagging Super-Resolution Optical Fluctuation Imaging , 2015, Scientific reports.

[4]  Anne Sentenac,et al.  Structured illumination microscopy using unknown speckle patterns , 2012, Nature Photonics.

[5]  A. Kapanidis,et al.  Biology, one molecule at a time. , 2009, Trends in biochemical sciences.

[6]  Jerome Mertz,et al.  Scanning light-sheet microscopy in the whole mouse brain with HiLo background rejection. , 2010, Journal of biomedical optics.

[7]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[8]  Kai Wicker,et al.  Non-iterative determination of pattern phase in structured illumination microscopy using auto-correlations in Fourier space. , 2013, Optics express.

[9]  Yichen Ding,et al.  Achieving λ/10 Resolution CW STED Nanoscopy with a Ti:Sapphire Oscillator , 2012, PloS one.

[10]  Christoph Pieper,et al.  Resolution doubling in fluorescence microscopy with confocal spinning-disk image scanning microscopy , 2013, Proceedings of the National Academy of Sciences.

[11]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[12]  Karel Fliegel,et al.  SIMToolbox: a MATLAB toolbox for structured illumination fluorescence microscopy , 2015, Bioinform..

[13]  Jörg Enderlein,et al.  Image scanning microscopy. , 2010, Physical review letters.

[14]  H J Caulfield,et al.  Deconvolution of multiple images of the same object. , 1994, Applied optics.

[15]  L H Schaefer,et al.  Structured illumination microscopy: artefact analysis and reduction utilizing a parameter optimization approach , 2004, Journal of microscopy.

[16]  S. Hell,et al.  Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopy. , 1994, Optics letters.

[17]  James R. Fienup,et al.  Comparison of reconstruction algorithms for images from sparse-aperture systems , 2002, SPIE Optics + Photonics.

[18]  Jack D. Gaskill,et al.  Linear systems, fourier transforms, and optics , 1978, Wiley series in pure and applied optics.

[19]  Kaikai Guo,et al.  Resolution doubling with a reduced number of image acquisitions. , 2015, Biomedical optics express.

[20]  Wesley R. Legant,et al.  Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution , 2014, Science.

[21]  J. J. Macklin,et al.  Nonlinear structured-illumination microscopy with a photoswitchable protein reveals cellular structures at 50-nm resolution , 2011, Proceedings of the National Academy of Sciences.

[22]  Superresolution Optical fluctuations imaging (SOFI) , 2010 .

[23]  Philipp J. Keller,et al.  Fast, high-contrast imaging of animal development with scanned light sheet–based structured-illumination microscopy , 2010, Nature Methods.

[24]  Ian M. Dobbie,et al.  SIMcheck: a Toolbox for Successful Super-resolution Structured Illumination Microscopy , 2015, Scientific Reports.

[25]  G. Guo,et al.  Subdiffraction optical manipulation of the charge state of nitrogen vacancy center in diamond , 2015, Light: Science & Applications.

[26]  Wen-Di Li,et al.  Sub-diffraction imaging of nitrogen-vacancy centers in diamond by stimulated emission depletion and structured illumination , 2014 .

[27]  Reto Fiolka,et al.  Phase optimisation for structured illumination microscopy. , 2013, Optics express.

[28]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[29]  Jia'er Chen,et al.  The National Natural Science Fundation of China , 2003 .

[30]  M. Gustafsson Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[31]  M. Davidson,et al.  Extended-resolution structured illumination imaging of endocytic and cytoskeletal dynamics , 2015, Science.

[32]  Jerome Mertz,et al.  Optical sectioning microscopy with planar or structured illumination , 2011, Nature Methods.

[33]  Zhaowei Liu,et al.  Plasmonic structured illumination microscopy. , 2010, Nano letters.

[34]  S. Weiss,et al.  Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI) , 2009, Proceedings of the National Academy of Sciences.

[35]  Paul S Weiss,et al.  Nobel prizes for super-resolution imaging. , 2014, ACS nano.

[36]  Satoshi Kawata,et al.  High-resolution confocal microscopy by saturated excitation of fluorescence. , 2007, Physical review letters.

[37]  Michael D. Mason,et al.  Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. , 2006, Biophysical journal.

[38]  S. Hell Far-Field Optical Nanoscopy , 2007, Science.

[39]  Shimon Weiss,et al.  Superresolution optical fluctuation imaging (SOFI). , 2012, Advances in experimental medicine and biology.

[40]  A. Papoulis Linear systems, Fourier transforms, and optics , 1981, Proceedings of the IEEE.

[41]  Rainer Heintzmann,et al.  Laterally modulated excitation microscopy: improvement of resolution by using a diffraction grating , 1999, European Conference on Biomedical Optics.

[42]  M. Gustafsson,et al.  Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination. , 2008, Biophysical journal.

[43]  Bryant B. Chhun,et al.  Super-Resolution Video Microscopy of Live Cells by Structured Illumination , 2009, Nature Methods.

[44]  Rainer Heintzmann,et al.  Resolving a misconception about structured illumination , 2014, Nature Photonics.

[45]  Vincent Loriette,et al.  Bayesian Estimation for Optimized Structured Illumination Microscopy , 2012, IEEE Transactions on Image Processing.

[46]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[47]  Joshua W. Shaevitz,et al.  Spatial Covariance Reconstructive (SCORE) Super-Resolution Fluorescence Microscopy , 2014, PloS one.

[48]  Sapna A. Shroff,et al.  Lateral superresolution using a posteriori phase shift estimation for a moving object: experimental results. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.