High-throughput fluorescence microscopy using multi-frame motion deblurring.

We demonstrate multi-frame motion deblurring for gigapixel wide-field fluorescence microscopy using fast slide scanning with coded illumination. Our method illuminates the sample with multiple pulses within each exposure, in order to introduce structured motion blur. By deconvolving this known motion sequence from the set of acquired measurements, we recover the object with up to 10× higher SNR than when illuminated with a single pulse (strobed illumination), while performing acquisition at 5× higher frame-rate than a comparable stop-and-stare method. Our coded illumination sequence is optimized to maximize the reconstruction SNR. We also derive a framework for determining when coded illumination is SNR-optimal in terms of system parameters such as source illuminance, noise, and motion stage specifications. This helps system designers to choose the ideal technique for high-throughput microscopy of very large samples.

[1]  G. Meynants,et al.  Time-Delay-Integration Architectures in CMOS Image Sensors , 2009, IEEE Transactions on Electron Devices.

[2]  Laura Waller,et al.  Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array , 2015, PloS one.

[3]  G. Bottiroli,et al.  Autofluorescence Spectroscopy and Imaging: A Tool for Biomedical Research and Diagnosis , 2014, European journal of histochemistry : EJH.

[4]  Zeev Zalevsky,et al.  Space–bandwidth product of optical signals and systems , 1996 .

[5]  Yukako Yagi,et al.  Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. , 2006, Human pathology.

[6]  Laura Waller,et al.  Computational illumination for high-speed in vitro Fourier ptychographic microscopy , 2015, 1506.04274.

[7]  Lani F. Wu,et al.  Multidimensional Drug Profiling By Automated Microscopy , 2004, Science.

[8]  Ricardo Nitrini,et al.  Brain bank of the Brazilian aging brain study group—a milestone reached and more than 1,600 collected brains , 2006, Cell and Tissue Banking.

[9]  Shree K. Nayar,et al.  When Does Computational Imaging Improve Performance? , 2013, IEEE Transactions on Image Processing.

[10]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[11]  Lei Tian,et al.  Deep learning approach for Fourier ptychography microscopy. , 2018, Optics express.

[12]  Lei Tian,et al.  Reliable deep-learning-based phase imaging with uncertainty quantification. , 2019 .

[13]  A. Poustka,et al.  A microscope‐based screening platform for large‐scale functional protein analysis in intact cells , 2003, FEBS letters.

[14]  Nico Stuurman,et al.  Computer Control of Microscopes Using µManager , 2010, Current protocols in molecular biology.

[15]  Henry Pinkard,et al.  Deep learning for single-shot autofocus microscopy , 2019, Optica.

[16]  Ashok Veeraraghavan,et al.  A Framework for Analysis of Computational Imaging Systems: Role of Signal Prior, Sensor Noise and Multiplexing , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Priscille Brodin,et al.  High-content screening in infectious diseases. , 2011, Current opinion in chemical biology.

[18]  Marc Bickle,et al.  The beautiful cell: high-content screening in drug discovery , 2010, Analytical and bioanalytical chemistry.

[19]  M. Gustafsson.  Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[20]  E. O’Shea,et al.  Global analysis of protein localization in budding yeast , 2003, Nature.

[21]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[22]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[23]  S. Achilefu,et al.  Fluorescence lifetime measurements and biological imaging. , 2010, Chemical reviews.

[24]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[25]  Yibo Zhang,et al.  Deep Learning Microscopy , 2017, ArXiv.

[26]  Kannan Ramchandran,et al.  Multiplexed coded illumination for Fourier Ptychography with an LED array microscope. , 2014, Biomedical optics express.

[27]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[28]  B. Volk,et al.  Alcohol embryo- and fetopathy Neuropathology of 3 children and 3 fetuses , 1979, Journal of the Neurological Sciences.

[29]  J. Rodenburg,et al.  A phase retrieval algorithm for shifting illumination , 2004 .

[30]  Robert Kiss,et al.  How Could Static Telepathology Improve Diagnosis in Neuropathology? , 2000, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[31]  Qionghai Dai,et al.  Motion deblurring with temporally coded illumination in an LED array microscope. , 2015, Optics letters.

[32]  Lea T. Grinberg,et al.  Automating cell detection and classification in human brain fluorescent microscopy images using dictionary learning and sparse coding , 2017, Journal of Neuroscience Methods.

[33]  R. Horstmeyer,et al.  Wide-field, high-resolution Fourier ptychographic microscopy , 2013, Nature Photonics.

[34]  Y. Nesterov.  A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .