Open Access Research Article Evaluation of Methods for Detection of Fluorescence Labeled Subcellular Objects in Microscope Images

BackgroundSeveral algorithms have been proposed for detecting fluorescently labeled subcellular objects in microscope images. Many of these algorithms have been designed for specific tasks and validated with limited image data. But despite the potential of using extensive comparisons between algorithms to provide useful information to guide method selection and thus more accurate results, relatively few studies have been performed.ResultsTo better understand algorithm performance under different conditions, we have carried out a comparative study including eleven spot detection or segmentation algorithms from various application fields. We used microscope images from well plate experiments with a human osteosarcoma cell line and frames from image stacks of yeast cells in different focal planes. These experimentally derived images permit a comparison of method performance in realistic situations where the number of objects varies within image set. We also used simulated microscope images in order to compare the methods and validate them against a ground truth reference result. Our study finds major differences in the performance of different algorithms, in terms of both object counts and segmentation accuracies.ConclusionsThese results suggest that the selection of detection algorithms for image based screens should be done carefully and take into account different conditions, such as the possibility of acquiring empty images or images with very few spots. Our inclusion of methods that have not been used before in this context broadens the set of available detection methods and compares them against the current state-of-the-art methods for subcellular particle detection.

[1]  Edward R. Dougherty,et al.  Hands-on Morphological Image Processing , 2003 .

[2]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[3]  M. Sriram Iyengar,et al.  Cytoview: Development of a cell modelling framework , 2007, Journal of Biosciences.

[4]  Jing Zhang,et al.  Single cell cytometry of protein function in RNAi treated cells and in native populations , 2007 .

[5]  Pekka Ruusuvuori,et al.  Synthetic Images of High-Throughput Microscopy for Validation of Image Analysis Methods , 2008, Proceedings of the IEEE.

[6]  G. Matheron Random Sets and Integral Geometry , 1976 .

[7]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[8]  N. Perrimon,et al.  Genome-Wide RNAi Analysis of Growth and Viability in Drosophila Cells , 2004, Science.

[9]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[10]  Lucas Pelkmans,et al.  Lessons from genetics: interpreting complex phenotypes in RNAi screens. , 2008, Current opinion in cell biology.

[11]  Anne E Carpenter,et al.  Cell microarrays and RNA interference chip away at gene function , 2005, Nature Genetics.

[12]  Wiro J. Niessen,et al.  Quantitative comparison of spot detection methods in live-cell fluorescence microscopy imaging , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Dimiter Prodanov,et al.  Automatic morphometry of synaptic boutons of cultured cells using granulometric analysis of digital images , 2006, Journal of Neuroscience Methods.

[14]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[15]  Jean-Christophe Olivo-Marin,et al.  Extraction of spots in biological images using multiscale products , 2002, Pattern Recognit..

[16]  Pekka Ruusuvuori,et al.  Computational Framework for Simulating Fluorescence Microscope Images With Cell Populations , 2007, IEEE Transactions on Medical Imaging.

[17]  Anne E Carpenter Software opens the door to quantitative imaging , 2007, Nature Methods.

[18]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[19]  Xiaobo Zhou,et al.  Informatics challenges of high-throughput microscopy , 2006, IEEE Signal Processing Magazine.

[20]  J. Ellenberg,et al.  High-throughput fluorescence microscopy for systems biology , 2006, Nature Reviews Molecular Cell Biology.

[21]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[22]  Pekka Ruusuvuori,et al.  Benchmark set of synthetic images for validating cell image analysis algorithms , 2008, 2008 16th European Signal Processing Conference.

[23]  Chris A. Glasbey,et al.  An Analysis of Histogram-Based Thresholding Algorithms , 1993, CVGIP Graph. Model. Image Process..

[24]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[25]  Henry Horng-Shing Lu,et al.  Segmentation of cDNA microarray images by kernel density estimation , 2008, J. Biomed. Informatics.

[26]  E. O’Shea,et al.  Global analysis of protein localization in budding yeast , 2003, Nature.

[27]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[28]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[29]  Thomas Arildsen,et al.  Proceedings of the 17th European Signal Processing Conference (EUSIPCO-2009) , 2009 .

[30]  B. S. Manjunath,et al.  Evaluation and benchmark for biological image segmentation , 2008, 2008 15th IEEE International Conference on Image Processing.

[31]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[32]  中澤 真,et al.  Devroye, L., Gyorfi, L. and Lugosi, G. : A Probabilistic Theory of Pattern Recognition, Springer (1996). , 1997 .

[33]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[34]  Martin Engelhardt,et al.  Statistical validation metric for accuracy assessment in medical image segmentation , 2007, International Journal of Computer Assisted Radiology and Surgery.

[35]  Stephen T. C. Wong,et al.  Detection of molecular particles in live cells via machine learning , 2007, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[36]  D. Grier,et al.  Methods of Digital Video Microscopy for Colloidal Studies , 1996 .

[37]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[38]  Wiro J. Niessen,et al.  Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering , 2008, Medical Image Anal..