Software tools, data structures, and interfaces for microscope imaging.

The arrival of electronic photodetectors in biological microscopy has led to a revolution in the application of imaging in cell and developmental biology. The extreme photosensitivity of electronic photodetectors has enabled the routine use of multidimensional data acquisition spanning space and time and spectral range in live cell and tissue imaging. These techniques have provided key insights into the molecular and structural dynamics of living biology. However, digital photodetectors offer another advantage-they provide a linear mapping between the photon flux coming from the sample and the electronic sample they produce. Thus, an image presented as a visual representation of the sample is also a quantitative measurement of photon flux. These quantitative measurements are the basis of subsequent processing and analysis to improve signal contrast, to compare changes in the concentration of signal, and to reveal changes in cell structure and dynamics. For this reason, many laboratories and companies have committed their resources to software development, resulting in the availability of a large number of image-processing and analysis packages. In this article, we review the software tools for image data analysis that are now available and give some examples of their use in imaging experiments to reveal new insights into biological mechanisms. In our final section, we highlight some of the new directions for image analysis that are significant unmet challenges and present our own ideas for future directions.

[1]  Kenneth M. Yamada,et al.  What's in a picture? The temptation of image manipulation , 2004, The Journal of cell biology.

[2]  J. Ellenberg,et al.  Automatic real‐time three‐dimensional cell tracking by fluorescence microscopy , 2004, Journal of microscopy.

[3]  Jason R. Swedlow,et al.  Cajal Body dynamics and association with chromatin are ATP-dependent , 2002, Nature Cell Biology.

[4]  H. Erfle,et al.  High-throughput RNAi screening by time-lapse imaging of live human cells , 2006, Nature Methods.

[5]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[6]  W. Webb,et al.  Mobility measurement by analysis of fluorescence photobleaching recovery kinetics. , 1976, Biophysical journal.

[7]  Norbert Perrimon,et al.  Design and implementation of high-throughput RNAi screens in cultured Drosophila cells , 2007, Nature Protocols.

[8]  J. Lippincott-Schwartz,et al.  Studying protein dynamics in living cells , 2001, Nature Reviews Molecular Cell Biology.

[9]  Robert F. Murphy,et al.  A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells , 2001, Bioinform..

[10]  F. Wouters,et al.  Imaging biochemistry inside cells. , 2001, Trends in cell biology.

[11]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[12]  James G McNally,et al.  FRAP analysis of binding: proper and fitting. , 2005, Trends in cell biology.

[13]  D. M. Glover,et al.  Genome-wide survey of protein kinases required for cell cycle progression , 2004, Nature.

[14]  R. Wollman,et al.  Genes Required for Mitotic Spindle Assembly in Drosophila S2 Cells , 2007, Science.

[15]  J. Swedlow,et al.  Deconvolution in optical microscopy , 1996 .

[16]  J. Swedlow,et al.  A workingperson's guide to deconvolution in light microscopy. , 2001, BioTechniques.

[17]  G. Danuser,et al.  Quantitative fluorescent speckle microscopy of cytoskeleton dynamics. , 2006, Annual review of biophysics and biomolecular structure.

[18]  Hanchuan Peng,et al.  Automatic recognition and annotation of gene expression patterns of fly embryos , 2007, Bioinform..

[19]  P. Jansson.  Deconvolution of images and spectra , 1997 .

[20]  J. Ellenberg,et al.  Mapping the dynamic organization of the nuclear pore complex inside single living cells , 2004, Nature Cell Biology.

[21]  Maria Carmo-Fonseca,et al.  Intracellular macromolecular mobility measured by fluorescence recovery after photobleaching with confocal laser scanning microscopes. , 2004, Molecular biology of the cell.

[22]  K. Eliceiri,et al.  Bioimage informatics for experimental biology. , 2009, Annual review of biophysics.

[23]  Lior Shamir,et al.  WND-CHARM: Multi-purpose image classification using compound image transforms , 2008, Pattern Recognit. Lett..

[24]  Douglas A. Creager,et al.  The Open Microscopy Environment (OME) Data Model and XML file: open tools for informatics and quantitative analysis in biological imaging , 2005, Genome Biology.