Quantitative comparison of multiframe data association techniques for particle tracking in time-lapse fluorescence microscopy

Biological studies of intracellular dynamic processes commonly require motion analysis of large numbers of particles in live-cell time-lapse fluorescence microscopy imaging data. Many particle tracking methods have been developed in the past years as a first step toward fully automating this task and enabling high-throughput data processing. Two crucial aspects of any particle tracking method are the detection of relevant particles in the image frames and their linking or association from frame to frame to reconstruct the trajectories. The performance of detection techniques as well as specific combinations of detection and linking techniques for particle tracking have been extensively evaluated in recent studies. Comprehensive evaluations of linking techniques per se, on the other hand, are lacking in the literature. Here we present the results of a quantitative comparison of data association techniques for solving the linking problem in biological particle tracking applications. Nine multiframe and two more traditional two-frame techniques are evaluated as a function of the level of missing and spurious detections in various scenarios. The results indicate that linking techniques are generally more negatively affected by missing detections than by spurious detections. If misdetections can be avoided, there appears to be no need to use sophisticated multiframe linking techniques. However, in the practically likely case of imperfect detections, the latter are a safer choice. Our study provides users and developers with novel information to select the right linking technique for their applications, given a detection technique of known quality.

[1]  S. Simon,et al.  Tracking single proteins within cells. , 2000, Biophysical journal.

[2]  Thomas Dertinger,et al.  Super-resolution microscopy heads towards 3D dynamics , 2013 .

[3]  M. Unser,et al.  The colored revolution of bioimaging , 2006, IEEE Signal Processing Magazine.

[4]  S. Shorte,et al.  Quantitative four-dimensional tracking of cytoplasmic and nuclear HIV-1 complexes , 2006, Nature Methods.

[5]  Stephen T. C. Wong,et al.  Tracking molecular particles in live cells using fuzzy rule‐based system , 2007, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[6]  J. Pawley,et al.  Handbook of Biological Confocal Microscopy , 1990, Springer US.

[7]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[8]  Isabelle Bloch,et al.  Multiple Hypothesis Tracking for Cluttered Biological Image Sequences , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[10]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dmitry Chetverikov,et al.  Feature Point Tracking for Incomplete Trajectories , 1999, Computing.

[12]  Tai-Yu Chiu,et al.  An automated tracking system to measure the dynamic properties of vesicles in living cells , 2007, Microscopy research and technique.

[13]  A. Trubuil,et al.  Visualization and quantification of vesicle trafficking on a three‐dimensional cytoskeleton network in living cells , 2007, Journal of microscopy.

[14]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[15]  Stefano Coraluppi,et al.  Multi-Stage Multiple-Hypothesis Tracking , 2011, J. Adv. Inf. Fusion.

[16]  Wiro J. Niessen,et al.  Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering , 2008, Medical Image Anal..

[17]  Hans Driessen,et al.  An efficient particle filter for jump Markov nonlinear systems , 2004 .

[18]  Laurent D. Cohen,et al.  Single quantum dot tracking based on perceptual Grouping using minimal paths in a spatiotemporal volume , 2005, IEEE Transactions on Image Processing.

[19]  Gaudenz Danuser,et al.  Computational image analysis of cellular dynamics: a case study based on particle tracking. , 2009, Cold Spring Harbor protocols.

[20]  Y. Bar-Shalom,et al.  A generalized S-D assignment algorithm for multisensor-multitarget state estimation , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[21]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[22]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[23]  Kai Zhang,et al.  Automated image analysis for tracking cargo transport in axons , 2011, Microscopy research and technique.

[24]  E. Fedorov,et al.  Multiple-particle tracking measurements of heterogeneities in solutions of actin filaments and actin bundles. , 2000, Biophysical journal.

[25]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[26]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[27]  H. Leonhardt,et al.  A guide to super-resolution fluorescence microscopy , 2010, The Journal of cell biology.

[28]  Karl Rohr,et al.  Tracking virus particles in fluorescence microscopy images using two-step multi-frame association , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[29]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[30]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[31]  Yannis Kalaidzidis,et al.  Multiple objects tracking in fluorescence microscopy , 2008, Journal of mathematical biology.

[32]  Ingemar J. Cox,et al.  A review of statistical data association techniques for motion correspondence , 1993, International Journal of Computer Vision.

[33]  Gaudenz Danuser,et al.  Computational processing and analysis of dynamic fluorescence image data. , 2008, Methods in cell biology.

[34]  David Zwicker,et al.  Tracking single particles and elongated filaments with nanometer precision. , 2011, Biophysical journal.

[35]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[36]  Aubrey B. Poore,et al.  Some assignment problems arising from multiple target tracking , 2006, Math. Comput. Model..

[37]  B. C. Carter,et al.  Tracking single particles: a user-friendly quantitative evaluation , 2005, Physical biology.

[38]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[39]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[40]  Clare M. Waterman,et al.  Advances in light-based imaging of three-dimensional cellular ultrastructure. , 2012, Current opinion in cell biology.

[41]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[42]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[43]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[44]  Pekka Ruusuvuori,et al.  Open Access Research Article Evaluation of Methods for Detection of Fluorescence Labeled Subcellular Objects in Microscope Images , 2022 .

[45]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[46]  Wiro J. Niessen,et al.  Microtubule Dynamics Analysis Using Kymographs and Variable-Rate Particle Filters , 2010, IEEE Transactions on Image Processing.

[47]  Mubarak Shah,et al.  A noniterative greedy algorithm for multiframe point correspondence , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  I. Smal,et al.  Tracking in cell and developmental biology. , 2009, Seminars in cell & developmental biology.

[49]  W Tvaruskó,et al.  Time-resolved analysis and visualization of dynamic processes in living cells. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[50]  G. Patterson Fluorescence microscopy below the diffraction limit. , 2009, Seminars in cell & developmental biology.

[51]  Yi Yang,et al.  Multiple dense particle tracking in fluorescence microscopy images based on multidimensional assignment. , 2011, Journal of structural biology.

[52]  J. Willemse,et al.  Single particle tracking of dynamically localizing TatA complexes in Streptomyces coelicolor. , 2013, Biochemical and biophysical research communications.

[53]  M. Dawson,et al.  The how and why of what went where in apparent motion: modeling solutions to the motion correspondence problem. , 1991, Psychological review.

[54]  Victoria J Allan,et al.  Light Microscopy Techniques for Live Cell Imaging , 2003, Science.

[55]  W. Webb,et al.  Automated detection and tracking of individual and clustered cell surface low density lipoprotein receptor molecules. , 1994, Biophysical journal.

[56]  Y. Kalaidzidis Intracellular objects tracking. , 2007, European journal of cell biology.

[57]  Karl Rohr,et al.  Deterministic and probabilistic approaches for tracking virus particles in time-lapse fluorescence microscopy image sequences , 2009, Medical Image Anal..

[58]  Michael J Saxton,et al.  Single-particle tracking: connecting the dots , 2008, Nature Methods.

[59]  Hari Shroff,et al.  Advances in the speed and resolution of light microscopy , 2008, Current Opinion in Neurobiology.

[60]  Lei Yang,et al.  A New Framework for Particle Detection in Low-SNR Fluorescence Live-Cell Images and Its Application for Improved Particle Tracking , 2012, IEEE Transactions on Biomedical Engineering.

[61]  Iain D. C. Fraser,et al.  A simple method for automatic tracking of actin filaments in the motility assay , 1996, Journal of Muscle Research & Cell Motility.

[62]  Melike Lakadamyali,et al.  Super-resolution microscopy: going live and going fast. , 2014, Chemphyschem : a European journal of chemical physics and physical chemistry.

[63]  James S. Duncan,et al.  A Novel Multiple Hypothesis Based Particle Tracking Method for Clathrin Mediated Endocytosis Analysis Using Fluorescence Microscopy , 2014, IEEE Transactions on Image Processing.

[64]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[65]  Aubrey B. Poore,et al.  A New Lagrangian Relaxation Based Algorithm for a Class of Multidimensional Assignment Problems , 1997, Comput. Optim. Appl..

[66]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.

[67]  Marisa L. Martin-Fernandez,et al.  Automated multidimensional single molecule fluorescence microscopy feature detection and tracking , 2011, European Biophysics Journal.

[68]  Gaudenz Danuser,et al.  plusTipTracker: Quantitative image analysis software for the measurement of microtubule dynamics. , 2011, Journal of structural biology.

[69]  Cor J. Veenman,et al.  Motion tracking as a constrained optimization problem , 2003, Pattern Recognit..

[70]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[71]  François Bourgeois,et al.  An extension of the Munkres algorithm for the assignment problem to rectangular matrices , 1971, CACM.

[72]  Wiro J. Niessen,et al.  Rao-Blackwellized Marginal Particle Filtering for Multiple Object Tracking in Molecular Bioimaging , 2007, IPMI.

[73]  Nathalie Harder,et al.  Tracking and quantitative analysis of dynamic movements of cells and particles. , 2010, Cold Spring Harbor protocols.