Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy

Quantitative analysis of biological image data generally involves the detection of many subresolution spots. Especially in live cell imaging, for which fluorescence microscopy is often used, the signal-to-noise ratio (SNR) can be extremely low, making automated spot detection a very challenging task. In the past, many methods have been proposed to perform this task, but a thorough quantitative evaluation and comparison of these methods is lacking in the literature. In this paper, we evaluate the performance of the most frequently used detection methods for this purpose. These include seven unsupervised and two supervised methods. We perform experiments on synthetic images of three different types, for which the ground truth was available, as well as on real image data sets acquired for two different biological studies, for which we obtained expert manual annotations to compare with. The results from both types of experiments suggest that for very low SNRs ( ¿ 2), the supervised (machine learning) methods perform best overall. Of the unsupervised methods, the detectors based on the so-called h -dome transform from mathematical morphology or the multiscale variance-stabilizing transform perform comparably, and have the advantage that they do not require a cumbersome learning stage. At high SNRs ( > 5), the difference in performance of all considered detectors becomes negligible.

[1]  W. S. Rasband,et al.  ImageJ: Image processing and analysis in Java , 2012 .

[2]  R. Eils,et al.  4-D single particle tracking of synthetic and proteinaceous microspheres reveals preferential movement of nuclear particles along chromatin – poor tracks , 2004, BMC Cell Biology.

[3]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[4]  Carlos Pomalaza-Raez,et al.  Comparison Study Of Nonlinear Filters In Image Processing Applications , 1989 .

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Xiaobo Zhou,et al.  Informatics challenges of high-throughput microscopy , 2006, IEEE Signal Processing Magazine.

[7]  Victoria J Allan,et al.  Light Microscopy Techniques for Live Cell Imaging , 2003, Science.

[8]  George H Patterson,et al.  Photobleaching and photoactivation: following protein dynamics in living cells. , 2003, Nature cell biology.

[9]  Erik Meijering,et al.  Chapter 15 – Time‐Lapse Imaging , 2008 .

[10]  Milan Sonka,et al.  Image processing analysis and machine vision [2nd ed.] , 1999 .

[11]  R. Eils,et al.  Computational imaging in cell biology , 2003, The Journal of cell biology.

[12]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[13]  Robert D. Nowak,et al.  Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative prior , 2001, IEEE Trans. Image Process..

[14]  G. Lansbergen,et al.  Microtubule Plus End: A Hub of Cellular Activities , 2006, Traffic.

[15]  Patrick Bouthemy,et al.  Non-parametric regression for patch-based fluorescence microscopy image sequence denoising , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  H. Erfle,et al.  High-throughput RNAi screening by time-lapse imaging of live human cells , 2006, Nature Methods.

[18]  F. Gisou van der Goot,et al.  Eukaryotic cells and microbial pathogens: a familiar couple take centre stage , 2003, Nature Cell Biology.

[19]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[20]  G. Turin,et al.  An introduction to matched filters , 1960, IRE Trans. Inf. Theory.

[21]  Gaudenz Danuser,et al.  Computational processing and analysis of dynamic fluorescence image data. , 2008, Methods in cell biology.

[22]  D. Chakraborty,et al.  Free-response methodology: alternate analysis and a new observer-performance experiment. , 1990, Radiology.

[23]  Marcus Dyba,et al.  Concepts for nanoscale resolution in fluorescence microscopy , 2004, Current Opinion in Neurobiology.

[24]  Atsushi Miyawaki,et al.  Lighting up cells: labelling proteins with fluorophores. , 2003, Nature cell biology.

[25]  Roger Y Tsien,et al.  Imagining imaging's future. , 2003, Nature reviews. Molecular cell biology.

[26]  Yuval Garini,et al.  From micro to nano: recent advances in high-resolution microscopy. , 2005, Current opinion in biotechnology.

[27]  Jean-Christophe Olivo-Marin,et al.  Extraction of spots in biological images using multiscale products , 2002, Pattern Recognit..

[28]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[29]  D P Chakraborty,et al.  Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data. , 1989, Medical physics.

[30]  Wiro J. Niessen,et al.  A new detection scheme for multiple object tracking in fluorescence microscopy by joint probabilistic data association filtering , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[31]  J. Lippincott-Schwartz,et al.  Development and Use of Fluorescent Protein Markers in Living Cells , 2003, Science.

[32]  J. Ellenberg,et al.  4D imaging to assay complex dynamics in live specimens. , 2003, Nature cell biology.

[33]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[35]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[36]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[37]  Mohamed-Jalal Fadili,et al.  Multiscale Variance-Stabilizing Transform for Mixed-Poisson-Gaussian Processes and its Applications in Bioimaging , 2007, 2007 IEEE International Conference on Image Processing.

[38]  Patrick Bouthemy,et al.  A simulation and estimation framework for intracellular dynamics and trafficking in video-microscopy and fluorescence imagery , 2008 .

[39]  M. Unser,et al.  The colored revolution of bioimaging , 2006, IEEE Signal Processing Magazine.

[40]  S. Mallat A wavelet tour of signal processing , 1998 .

[41]  Thomas S. Huang,et al.  Image processing , 1971 .

[42]  J.-L. Starck,et al.  Astronomical image and signal processing: looking at noise, information and scale , 2001, IEEE Signal Processing Magazine.

[43]  Stephen T. C. Wong,et al.  Detection of molecular particles in live cells via machine learning , 2007, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[44]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[45]  D. Donoho,et al.  Redundant Multiscale Transforms and Their Application for Morphological Component Separation , 2004 .

[46]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[47]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[48]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[49]  Pamela A Silver,et al.  Motion as a phenotype: the use of live-cell imaging and machine visual screening to characterize transcription-dependent chromosome dynamics , 2006, BMC Cell Biology.

[50]  Abramoff ImageJ as an Image Processing Tool and Library , 2007, Microscopy and Microanalysis.

[51]  Ilya Grigoriev,et al.  Rab6 regulates transport and targeting of exocytotic carriers. , 2007, Developmental cell.

[52]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[53]  Niels Galjart,et al.  Visualization of Microtubule Growth in Cultured Neurons via the Use of EB3-GFP (End-Binding Protein 3-Green Fluorescent Protein) , 2003, The Journal of Neuroscience.

[54]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[55]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[56]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[57]  B. C. Carter,et al.  Tracking single particles: a user-friendly quantitative evaluation , 2005, Physical biology.

[58]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[59]  Yuval Garini,et al.  Segmentation and analysis of the three‐dimensional redistribution of nuclear components in human mesenchymal stem cells , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[60]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[61]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[62]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[63]  Stephen T. C. Wong,et al.  Tracking molecular particles in live cells using fuzzy rule‐based system , 2007, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[64]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[65]  Wiro J. Niessen,et al.  Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering , 2008, Medical Image Anal..

[66]  Qiang Wu,et al.  Microscope Image Processing , 2010 .

[67]  M. Girgenrath,et al.  Immortalization of mouse myogenic cells can occur without loss of p16INK4a, p19ARF, or p53 and is accelerated by inactivation of Bax , 2004, BMC Cell Biology.

[68]  Laurent D. Cohen,et al.  Single quantum dot tracking based on perceptual Grouping using minimal paths in a spatiotemporal volume , 2005, IEEE Transactions on Image Processing.

[69]  Y. Kalaidzidis Intracellular objects tracking. , 2007, European journal of cell biology.

[70]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[71]  D. Bright,et al.  Two‐dimensional top hat filter for extracting spots and spheres from digital images , 1987 .

[72]  Erik Meijering,et al.  Quantitative Biological Image Analysis , 2007 .

[73]  Bart M. ter Haar Romeny,et al.  Front-End Vision and Multi-Scale Image Analysis , 2003, Computational Imaging and Vision.

[74]  J. Ellenberg,et al.  High-throughput fluorescence microscopy for systems biology , 2006, Nature Reviews Molecular Cell Biology.

[75]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[76]  Arif Ghafoor,et al.  State of the Art in Information Extraction and Quantitative Analysis for Multimodality Biomolecular Imaging , 2008, Proceedings of the IEEE.

[77]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[78]  Jean-Luc Starck,et al.  Astronomical image and data analysis , 2002 .

[79]  Mohamed-Jalal Fadili,et al.  The Undecimated Wavelet Decomposition and its Reconstruction , 2007, IEEE Transactions on Image Processing.

[80]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.