Design Principles for Autonomous Illumination Control in Localization Microscopy

Super-resolution fluorescence microscopy improves spatial resolution, but this comes at a loss of image throughput and presents unique challenges in identifying optimal acquisition parameters. Microscope automation routines can offset these drawbacks, but thus far have required user inputs that presume a priori knowledge about the sample. Here, we develop a flexible illumination control system for localization microscopy comprised of two interacting components that require no sample-specific inputs: a self-tuning controller and a deep learning molecule density estimator that is accurate over an extended range. This system obviates the need to fine-tune parameters and demonstrates the design of modular illumination control for localization microscopy.

[1]  Christophe Leterrier,et al.  NanoJ-SQUIRREL: quantitative mapping and minimisation of super-resolution optical imaging artefacts , 2018, Nature Methods.

[2]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[3]  Benjamin Recht,et al.  DeepLoco: Fast 3D Localization Microscopy Using Neural Networks , 2018, bioRxiv.

[4]  Tomer Michaeli,et al.  Deep-STORM: super-resolution single-molecule microscopy by deep learning , 2018, 1801.09631.

[5]  A. Picco,et al.  Systematic analysis of the molecular architecture of endocytosis reveals a nanoscale actin nucleation template that drives efficient vesicle formation , 2017, bioRxiv.

[6]  Daniel Choquet,et al.  Localization-based super-resolution imaging meets high-content screening , 2017, Nature Methods.

[7]  Xiao Zhao,et al.  The connected-component labeling problem: A review of state-of-the-art algorithms , 2017, Pattern Recognit..

[8]  K. Lidke,et al.  AUTOMATED MULTIPLE TARGET SUPERRESOLUTION IMAGING , 2017 .

[9]  Zhen-Li Huang,et al.  High-power homogeneous illumination for super-resolution localization microscopy with large field-of-view. , 2017, Optics express.

[10]  Thierry Blu,et al.  Fast and accurate three-dimensional point spread function computation for fluorescence microscopy. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Antoni B. Chan,et al.  Beyond Counting: Comparisons of Density Maps for Crowd Analysis Tasks—Counting, Detection, and Tracking , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  T. Huser,et al.  Chip-based wide field-of-view nanoscopy , 2017, Nature Photonics.

[13]  Patrick Fox-Roberts,et al.  Local dimensionality determines imaging speed in localization microscopy , 2017, Nature Communications.

[14]  Daniel Oñoro-Rubio,et al.  Towards Perspective-Free Object Counting with Deep Learning , 2016, ECCV.

[15]  Kyle M. Douglass,et al.  Super-resolution imaging of multiple cells by optimised flat-field epi-illumination , 2016, Nature Photonics.

[16]  Ricardo Henriques,et al.  Fast live-cell conventional fluorophore nanoscopy with ImageJ through super-resolution radial fluctuations , 2016, Nature Communications.

[17]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[18]  Zhen Zhang,et al.  Trade-offs between structural integrity and acquisition time in stochastic super-resolution microscopy techniques. , 2016, Optics express.

[19]  M. Sauer,et al.  Artifacts in single-molecule localization microscopy , 2015, Histochemistry and Cell Biology.

[20]  Suliana Manley,et al.  Quantitative evaluation of software packages for single-molecule localization microscopy , 2015, Nature Methods.

[21]  Fang Huang,et al.  Quantifying and Optimizing Single-Molecule Switching Nanoscopy at High Speeds , 2015, PloS one.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Henry Pinkard,et al.  Advanced methods of microscope control using μManager software. , 2014, Journal of biological methods.

[24]  Andrew Zisserman,et al.  Interactive Object Counting , 2014, ECCV.

[25]  Guy M. Hagen,et al.  ThunderSTORM: a comprehensive ImageJ plug-in for PALM and STORM data analysis and super-resolution imaging , 2014, Bioinform..

[26]  S. Manley,et al.  High throughput 3D super-resolution microscopy reveals Caulobacter crescentus in vivo Z-ring organization , 2014, Proceedings of the National Academy of Sciences.

[27]  M. Beck,et al.  Fourier ring correlation as a resolution criterion for super-resolution microscopy. , 2013, Journal of structural biology.

[28]  J. Sibarita,et al.  Real-Time Analysis and Visualization for Single-Molecule Based Super-Resolution Microscopy , 2013, PloS one.

[29]  Sjoerd Stallinga,et al.  Measuring image resolution in optical nanoscopy , 2013, Nature Methods.

[30]  Ullrich Köthe,et al.  Learning to count with regression forest and structured labels , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[31]  M. Dahan,et al.  Wavelet analysis for single molecule localization microscopy. , 2012, Optics express.

[32]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[33]  S. Weiss,et al.  Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI) , 2009, Proceedings of the National Academy of Sciences.

[34]  M. Heilemann,et al.  Subdiffraction-resolution fluorescence imaging with conventional fluorescent probes. , 2008, Angewandte Chemie.

[35]  Michael D. Mason,et al.  Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. , 2006, Biophysical journal.

[36]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[37]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[38]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[39]  J. Bechhoefer Feedback for physicists: A tutorial essay on control , 2005 .

[40]  S. Gibson,et al.  Experimental test of an analytical model of aberration in an oil-immersion objective lens used in three-dimensional light microscopy. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[41]  C. Allain,et al.  Characterizing the lacunarity of random and deterministic fractal sets. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[42]  Ken Perlin,et al.  An image synthesizer , 1988 .

[43]  Holger Erfle,et al.  Fully Automated Targeted Confocal and Single-Molecule Localization Microscopy. , 2017, Methods in molecular biology.

[44]  S. Manley,et al.  Optimisation and control of sampling rate in localisation microscopy , 2013 .