Adaptive light-sheet microscopy for long-term, high-resolution imaging in living organisms

Optimal image quality in light-sheet microscopy requires a perfect overlap between the illuminating light sheet and the focal plane of the detection objective. However, mismatches between the light-sheet and detection planes are common owing to the spatiotemporally varying optical properties of living specimens. Here we present the AutoPilot framework, an automated method for spatiotemporally adaptive imaging that integrates (i) a multi-view light-sheet microscope capable of digitally translating and rotating light-sheet and detection planes in three dimensions and (ii) a computational method that continuously optimizes spatial resolution across the specimen volume in real time. We demonstrate long-term adaptive imaging of entire developing zebrafish (Danio rerio) and Drosophila melanogaster embryos and perform adaptive whole-brain functional imaging in larval zebrafish. Our method improves spatial resolution and signal strength two to five-fold, recovers cellular and sub-cellular structures in many regions that are not resolved by non-adaptive imaging, adapts to spatiotemporal dynamics of genetically encoded fluorescent markers and robustly optimizes imaging performance during large-scale morphogenetic changes in living organisms.

[1]  David Artigas,et al.  A simple scanless two-photon fluorescence microscope using selective plane illumination. , 2010, Optics express.

[2]  Hari Shroff,et al.  Faster fluorescence microscopy: advances in high speed biological imaging. , 2014, Current opinion in chemical biology.

[3]  Periklis Pantazis,et al.  Advances in whole-embryo imaging: a quantitative transition is underway , 2014, Nature Reviews Molecular Cell Biology.

[4]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[5]  Max Born,et al.  Principles of optics - electromagnetic theory of propagation, interference and diffraction of light (7. ed.) , 1999 .

[6]  Daniel A. Colón-Ramos,et al.  Inverted selective plane illumination microscopy (iSPIM) enables coupled cell identity lineaging and neurodevelopmental imaging in Caenorhabditis elegans , 2011, Proceedings of the National Academy of Sciences.

[7]  Kristin Branson,et al.  Whole-central nervous system functional imaging in larval Drosophila , 2015, Nature Communications.

[8]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[9]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[10]  Ernst H K Stelzer,et al.  Light-sheet fluorescence microscopy for quantitative biology , 2014, Nature Methods.

[11]  Nico Stuurman,et al.  Computer Control of Microscopes Using µManager , 2010, Current protocols in molecular biology.

[12]  T. Holy,et al.  Image-based calibration of a deformable mirror in wide-field microscopy. , 2010, Applied optics.

[13]  Yibin Tian,et al.  Monte Carlo evaluations of ten focus measures , 2007, Electronic Imaging.

[14]  F. Del Bene,et al.  Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy , 2004, Science.

[15]  Michael Schroeder,et al.  Network Compression as a Quality Measure for Protein Interaction Networks , 2012, PloS one.

[16]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[17]  Jan Flusser,et al.  A new wavelet-based measure of image focus , 2002, Pattern Recognit. Lett..

[18]  Lawrence G. Roberts,et al.  Picture coding using pseudo-random noise , 1962, IRE Trans. Inf. Theory.

[19]  Paul Escande,et al.  High-resolution in-depth imaging of optically cleared thick samples using an adaptive SPIM , 2015, Scientific Reports.

[20]  Na Ji,et al.  Multiplexed aberration measurement for deep tissue imaging in vivo , 2014, Nature Methods.

[21]  Diwakar Turaga,et al.  Aberrations and their correction in light-sheet microscopy: a low-dimensional parametrization. , 2013, Biomedical optics express.

[22]  Misha B. Ahrens,et al.  Visualizing Whole-Brain Activity and Development at the Single-Cell Level Using Light-Sheet Microscopy , 2015, Neuron.

[23]  Helmut Lippert,et al.  Light sheet microscope , 2016 .

[24]  Philipp J. Keller,et al.  Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet Microscopy , 2008, Science.

[25]  Wesley R. Legant,et al.  Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution , 2014, Science.

[26]  J. F. Brenner,et al.  An automated microscope for cytologic research a preliminary evaluation. , 1976, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[27]  Lars Hufnagel,et al.  Quantitative fluorescence imaging of protein diffusion and interaction in living cells , 2011, Nature Biotechnology.

[28]  M. Davidson,et al.  Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination , 2011, Nature Methods.

[29]  I T Young,et al.  A comparison of different focus functions for use in autofocus algorithms. , 1985, Cytometry.

[30]  Justin Senseney,et al.  Spatially isotropic four-dimensional imaging with dual-view plane illumination microscopy , 2013, Nature Biotechnology.

[31]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[32]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[33]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[34]  Francis A. Duck,et al.  Thermal Properties of Tissue , 1990 .

[35]  Jonathan M. Taylor,et al.  3D adaptive optics in a light sheet microscope. , 2012, Optics express.

[36]  Yibin Tian,et al.  Performance of focus measures in the presence of nondefocus aberrations. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[37]  D. Vollath.  The influence of the scene parameters and of noise on the behaviour of automatic focusing algorithms , 1988 .

[38]  Fernando Amat,et al.  Efficient processing and analysis of large-scale light-sheet microscopy data , 2015, Nature Protocols.

[39]  Carl Tim Kelley,et al.  Iterative methods for optimization , 1999, Frontiers in applied mathematics.

[40]  Philipp J. Keller,et al.  Fast, high-contrast imaging of animal development with scanned light sheet–based structured-illumination microscopy , 2010, Nature Methods.

[41]  Michael Broxton,et al.  Faculty Opinions recommendation of SPED light sheet microscopy: fast mapping of biological system structure and function. , 2016 .

[42]  A. Rohrbach,et al.  Microscopy with self-reconstructing beams , 2010 .

[43]  J. C. A. Barata,et al.  The Moore–Penrose Pseudoinverse: A Tutorial Review of the Theory , 2011, 1110.6882.

[44]  E. Hall,et al.  The nature of biotechnology. , 1988, Journal of biomedical engineering.

[45]  Francis A. Duck,et al.  Physical properties of tissue : a comprehensive reference book , 1990 .

[46]  Jan Huisken,et al.  Multilayer mounting enables long-term imaging of zebrafish development in a light sheet microscope , 2012, Development.

[47]  Rafael Yuste,et al.  Calcium imaging of neural circuits with extended depth-of-field light-sheet microscopy. , 2016, Optics letters.

[48]  Philipp J. Keller,et al.  Whole-animal functional and developmental imaging with isotropic spatial resolution , 2015, Nature Methods.

[49]  David S. Koos,et al.  Deep and fast live imaging with two-photon scanned light-sheet microscopy , 2011, Nature Methods.

[50]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[51]  P. Santi,et al.  Light Sheet Fluorescence Microscopy , 2011, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[52]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Philipp J. Keller,et al.  Imaging Morphogenesis: Technological Advances and Biological Insights , 2013, Science.

[54]  Willy Supatto,et al.  Quantitative imaging of collective cell migration during Drosophila gastrulation: multiphoton microscopy and computational analysis , 2009, Nature Protocols.

[55]  Philipp J. Keller,et al.  Quantitative high-speed imaging of entire developing embryos with simultaneous multiview light-sheet microscopy , 2012, Nature Methods.

[56]  Benjamin Schmid,et al.  Rapid 3D light-sheet microscopy with a tunable lens. , 2013, Optics express.

[57]  James G. Nagy,et al.  Large-Scale Image Deblurring in Java , 2008, ICCS.

[58]  D. Milkie,et al.  Rapid Adaptive Optical Recovery of Optimal Resolution over LargeVolumes , 2014, Nature Methods.

[59]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[60]  Joachim Wittbrodt,et al.  Quantitative analysis of embryogenesis: a perspective for light sheet microscopy. , 2012, Developmental cell.

[61]  Lining Sun,et al.  Construction and evaluation of a wavelet‐based focus measure for microscopy imaging , 2007, Microscopy research and technique.

[62]  James F. Blinn,et al.  What's that deal with the DCT? , 1993, IEEE Computer Graphics and Applications.

[63]  J. Huisken,et al.  The smart and gentle microscope , 2015, Nature Biotechnology.

[64]  Jan Huisken,et al.  Light sheet microscopy for real-time developmental biology. , 2011, Current opinion in genetics & development.