A real-time compression library for microscopy images

Fluorescence imaging techniques such as single molecule localization microscopy, high-content screening and light-sheet microscopy are producing ever-larger datasets, which poses increasing challenges in data handling and data sharing. Here, we introduce a real-time compression library that allows for very fast (beyond 1 GB/s) compression and de-compression of microscopy datasets during acquisition. In addition to an efficient lossless mode, our algorithm also includes a lossy option, which limits pixel deviations to the intrinsic noise level of the image and yields compression ratio of up to 100-fold. We present a detailed performance analysis of the different compression modes for various biological samples and imaging modalities.

[1]  M. Heilemann,et al.  Subdiffraction-resolution fluorescence imaging with conventional fluorescent probes. , 2008, Angewandte Chemie.

[2]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[3]  Fernando Amat,et al.  Efficient processing and analysis of large-scale light-sheet microscopy data , 2015, Nature Protocols.

[4]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[5]  Keith A. Lidke,et al.  Fast, single-molecule localization that achieves theoretically minimum uncertainty , 2010, Nature Methods.

[6]  Pavel Tomancak,et al.  Guide to light-sheet microscopy for adventurous biologists , 2014, Nature Methods.

[7]  Anne E Carpenter,et al.  Systematic genome-wide screens of gene function , 2004, Nature Reviews Genetics.

[8]  A. Schierloh,et al.  Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain , 2007, Nature Methods.

[9]  Tobias Pietzsch,et al.  BigDataViewer: visualization and processing for large image data sets , 2015, Nature Methods.

[10]  Andreas Rowald,et al.  Efficient homogeneous illumination and optical sectioning for quantitative single-molecule localization microscopy. , 2016, Optics express.

[11]  Douglas W Cromey,et al.  Digital images are data: and should be treated as such. , 2013, Methods in molecular biology.

[12]  Philipp J. Keller,et al.  Whole-animal functional and developmental imaging with isotropic spatial resolution , 2015, Nature Methods.

[13]  Kevin Skadron,et al.  Scalable parallel programming , 2008, 2008 IEEE Hot Chips 20 Symposium (HCS).

[14]  Khalid Sayood,et al.  Context-Based Compression , 2012 .

[15]  Jeffrey M. Perkel.  The struggle with image glut , 2016, Nature.

[16]  R. Wollman,et al.  High throughput microscopy: from raw images to discoveries , 2007, Journal of Cell Science.

[17]  Khalid Sayood.  Introduction to Data Compression, Fourth Edition , 2012 .

[18]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[19]  G. Malandain,et al.  Imaging plant growth in 4D: robust tissue reconstruction and lineaging at cell resolution , 2010, Nature Methods.

[20]  Nils Norlin,et al.  Confocal multiview light-sheet microscopy , 2015, Nature Communications.

[21]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[22]  Lars Hufnagel,et al.  Multiview light-sheet microscope for rapid in toto imaging , 2012, Nature Methods.

[23]  M. Mund,et al.  3D superresolution microscopy by supercritical angle detection. , 2014, Optics express.

[24]  Michael D. Mason,et al.  Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. , 2006, Biophysical journal.

[25]  F. Del Bene,et al.  Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy , 2004, Science.

[26]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[27]  J. Ellenberg,et al.  High-throughput fluorescence microscopy for systems biology , 2006, Nature Reviews Molecular Cell Biology.

[28]  Philipp J. Keller,et al.  Quantitative high-speed imaging of entire developing embryos with simultaneous multiview light-sheet microscopy , 2012, Nature Methods.

[29]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[30]  N. Perrimon,et al.  High-throughput RNAi screening in cultured cells: a user's guide , 2006, Nature Reviews Genetics.

[31]  M. Dahan,et al.  Wavelet analysis for single molecule localization microscopy. , 2012, Optics express.