Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis

Quantitative analysis of dynamic processes in living cells by means of fluorescence microscopy imaging requires tracking of hundreds of bright spots in noisy image sequences. Deterministic approaches, which use object detection prior to tracking, perform poorly in the case of noisy image data. We propose an improved, completely automatic tracker, built within a Bayesian probabilistic framework. It better exploits spatiotemporal information and prior knowledge than common approaches, yielding more robust tracking also in cases of photobleaching and object interaction. The tracking method was evaluated using simulated but realistic image sequences, for which ground truth was available. The results of these experiments show that the method is more accurate and robust than popular tracking methods. In addition, validation experiments were conducted with real fluorescence microscopy image data acquired for microtubule growth analysis. These demonstrate that the method yields results that are in good agreement with manual tracking performed by expert cell biologists. Our findings suggest that the method may replace laborious manual procedures.

[1]  N. Ikoma,et al.  Extended object tracking using particle techniques , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[2]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[3]  Niels Galjart,et al.  Visualization of Microtubule Growth in Cultured Neurons via the Use of EB3-GFP (End-Binding Protein 3-Green Fluorescent Protein) , 2003, The Journal of Neuroscience.

[4]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[5]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[6]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[7]  Wiro J. Niessen,et al.  Bayesian tracking for fluorescence microscopic imaging , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[8]  Cor J. Veenman,et al.  Motion tracking as a constrained optimization problem , 2003, Pattern Recognit..

[9]  Patrick Pérez,et al.  Maintaining multimodality through mixture tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Enrico Gratton,et al.  3-D particle tracking in a two-photon microscope: application to the study of molecular dynamics in cells. , 2005, Biophysical journal.

[11]  Arnold W. M. Smeulders,et al.  Velocity Estimation of Spots in 3D Confocal Image Sequeces of Living Cells , 2000 .

[12]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[13]  Cremer,et al.  High‐precision distance measurements and volume‐conserving segmentation of objects near and below the resolution limit in three‐dimensional confocal fluorescence microscopy , 1998 .

[14]  S. Gibson,et al.  Experimental test of an analytical model of aberration in an oil-immersion objective lens used in three-dimensional light microscopy. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[15]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[16]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[17]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2004, International Journal of Computer Vision.

[18]  Stefanie Kandels-Lewis,et al.  Discrete States of a Protein Interaction Network Govern Interphase and Mitotic Microtubule Dynamics , 2007, PLoS biology.

[19]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[20]  Douglas B. Kell,et al.  Automatic tracking of biological cells and compartments using particle filters and active contours , 2006 .

[21]  Chris I. De Zeeuw,et al.  CLASPs Are CLIP-115 and -170 Associating Proteins Involved in the Regional Regulation of Microtubule Dynamics in Motile Fibroblasts , 2001, Cell.

[22]  J. Ellenberg,et al.  Automatic real‐time three‐dimensional cell tracking by fluorescence microscopy , 2004, Journal of microscopy.

[23]  J. Vassy,et al.  High-resolution three-dimensional images from confocal scanning laser microscopy. Quantitative study and mathematical correction of the effects from bleaching and fluorescence attenuation in depth. , 1991, Analytical and quantitative cytology and histology.

[24]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[25]  Erik Meijering,et al.  Particle Filtering for Multiple Object Tracking in Molecular Cell Biology , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[26]  Eric Karsenti,et al.  Regulation of microtubule dynamics by cdc2 protein kinase in cell-free extracts of Xenopus eggs , 1990, Nature.

[27]  B. S. Manjunath,et al.  Automated tracking and modeling of microtubule dynamics , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[28]  Koon Yin Kong,et al.  Computer Assisted Analysis of Microtubule Dynamics in Living Cells , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[29]  Laurent D. Cohen,et al.  Single quantum dot tracking based on perceptual Grouping using minimal paths in a spatiotemporal volume , 2005, IEEE Transactions on Image Processing.

[30]  Rashid Ansari,et al.  Efficient tracking of cyclic human motion by component motion , 2004, IEEE Signal Processing Letters.

[31]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[32]  Y. Kosuge,et al.  The optimum gate shape and threshold for target tracking , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[33]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[34]  Takeo Kanade,et al.  Online Tracking of Migrating and Proliferating Cells Imaged with Phase-Contrast Microscopy , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[35]  P. Sorger,et al.  Automatic fluorescent tag localization II: improvement in super‐resolution by relative tracking , 2003, Journal of microscopy.

[36]  B. C. Carter,et al.  Tracking single particles: a user-friendly quantitative evaluation , 2005, Physical biology.

[37]  David Pellman,et al.  Surfing on microtubule ends. , 2003, Trends in cell biology.

[38]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[39]  David Tuck,et al.  Automatic quantification of microtubule dynamics , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[40]  Enrico Gratton,et al.  3D Particle Tracking on a Two-Photon Microscope , 2005, Journal of Fluorescence.

[41]  G. Lansbergen,et al.  Microtubule Plus End: A Hub of Cellular Activities , 2006, Traffic.

[42]  Anthony A. Hyman,et al.  Dynamics and mechanics of the microtubule plus end , 2022 .

[43]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[44]  Dmitry Chetverikov,et al.  Feature Point Tracking for Incomplete Trajectories , 1999, Computing.

[45]  Abramoff ImageJ as an Image Processing Tool and Library , 2007, Microscopy and Microanalysis.

[46]  Alan L. Yuille,et al.  Probabilistic Motion Estimation Based on Temporal Coherence , 2000, Neural Computation.

[47]  T. Mitchison,et al.  Microtubule polymerization dynamics. , 1997, Annual review of cell and developmental biology.

[48]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[49]  Wolfram Burgard,et al.  Robust vision-based localization by combining an image-retrieval system with Monte Carlo localization , 2005, IEEE Transactions on Robotics.

[50]  R. Eils,et al.  Quantitative motion analysis and visualization of cellular structures. , 2003, Methods.

[51]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[52]  F. Perez,et al.  CLIP-170 Highlights Growing Microtubule Ends In Vivo , 1999, Cell.

[53]  G J Streekstra,et al.  Velocity estimation of spots in three-dimensional confocal image sequences of living cells. , 2001, Cytometry.

[54]  Holy,et al.  Microtubule dynamics: Caps, catastrophes, and coupled hydrolysis. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[55]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[56]  David Pellman,et al.  Microtubule “Plus-End-Tracking Proteins” The End Is Just the Beginning , 2001, Cell.

[57]  B. Jähne,et al.  Motion determination in actin filament fluorescence images with a spatio-temporal orientation analysis method. , 2000, Biophysical journal.

[58]  W Tvaruskó,et al.  Time-resolved analysis and visualization of dynamic processes in living cells. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[60]  J. Vermaak,et al.  A hybrid approach for online joint detection and tracking for multiple targets , 2005, 2005 IEEE Aerospace Conference.

[61]  Patrick Pérez,et al.  Sequential Monte Carlo methods for multiple target tracking and data fusion , 2002, IEEE Trans. Signal Process..

[62]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  David A Schiffmann,et al.  Open microscopy environment and findspots: integrating image informatics with quantitative multidimensional image analysis. , 2006, BioTechniques.

[64]  Arnaud Doucet,et al.  Sequential Monte Carlo Methods , 2006, Handbook of Graphical Models.

[65]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[66]  C. Hoogenraad,et al.  Microtubule plus-end-tracking proteins: mechanisms and functions. , 2005, Current opinion in cell biology.

[67]  S. Leibler,et al.  Control of microtubule dynamics and length by cyclin A- and cyclin B- dependent kinases in Xenopus egg extracts , 1992, The Journal of cell biology.

[68]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  I. T. Young,et al.  Photobleaching kinetics of fluorescein in quantitative fluorescence microscopy. , 1995, Biophysical journal.

[70]  Ying Wu,et al.  Analyzing and capturing articulated hand motion in image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Jean X. Gao,et al.  A particle filter framework using optimal importance function for protein molecules tracking , 2005, IEEE International Conference on Image Processing 2005.