Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering

Time-lapse fluorescence microscopy imaging has rapidly evolved in the past decade and has opened new avenues for studying intracellular processes in vivo. Such studies generate vast amounts of noisy image data that cannot be analyzed efficiently and reliably by means of manual processing. Many popular tracking techniques exist but often fail to yield satisfactory results in the case of high object densities, high noise levels, and complex motion patterns. Probabilistic tracking algorithms, based on Bayesian estimation, have recently been shown to offer several improvements over classical approaches, by better integration of spatial and temporal information, and the possibility to more effectively incorporate prior knowledge about object dynamics and image formation. In this paper, we extend our previous work in this area and propose an improved, fully automated particle filtering algorithm for the tracking of many subresolution objects in fluorescence microscopy image sequences. It involves a new track management procedure and allows the use of multiple dynamics models. The accuracy and reliability of the algorithm are further improved by applying marginalization concepts. Experiments on synthetic as well as real image data from three different biological applications clearly demonstrate the superiority of the algorithm compared to previous particle filtering solutions.

[1]  T. Mitchison,et al.  Microtubule polymerization dynamics. , 1997, Annual review of cell and developmental biology.

[2]  Philippe Van Ham,et al.  Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes , 2005, IEEE Transactions on Medical Imaging.

[3]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Niels Galjart,et al.  Visualization of Microtubule Growth in Cultured Neurons via the Use of EB3-GFP (End-Binding Protein 3-Green Fluorescent Protein) , 2003, The Journal of Neuroscience.

[5]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[6]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[7]  Wiro J. Niessen,et al.  ADVANCED PARTICLE FILTERING FOR MULTIPLE OBJECT TRACKING IN DYNAMIC FLUORESCENCE MICROSCOPY IMAGES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  J. Ellenberg,et al.  4D imaging to assay complex dynamics in live specimens. , 2003, Nature cell biology.

[9]  Nando de Freitas,et al.  Toward Practical N2 Monte Carlo: the Marginal Particle Filter , 2005, UAI.

[10]  J. Vermaak,et al.  A hybrid approach for online joint detection and tracking for multiple targets , 2005, 2005 IEEE Aerospace Conference.

[11]  Adriaan B. Houtsmuller,et al.  Compartmentalization of androgen receptor protein–protein interactions in living cells , 2007, The Journal of cell biology.

[12]  J. Vassy,et al.  High-resolution three-dimensional images from confocal scanning laser microscopy. Quantitative study and mathematical correction of the effects from bleaching and fluorescence attenuation in depth. , 1991, Analytical and quantitative cytology and histology.

[13]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[14]  Y. Boers,et al.  Efficient particle filter for jump Markov nonlinear systems , 2005 .

[15]  H. Tabak,et al.  Peroxisomal membrane proteins are properly targeted to peroxisomes in the absence of COPI- and COPII-mediated vesicular transport. , 2001, Journal of cell science.

[16]  Niels Galjart,et al.  CLASP1 and CLASP2 bind to EB1 and regulate microtubule plus-end dynamics at the cell cortex , 2005, The Journal of cell biology.

[17]  B. C. Carter,et al.  Tracking single particles: a user-friendly quantitative evaluation , 2005, Physical biology.

[18]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[19]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[20]  Y. Boers,et al.  A particle-filter-based detection scheme , 2003, IEEE Signal Processing Letters.

[21]  Wiro J. Niessen,et al.  Rao-Blackwellized Marginal Particle Filtering for Multiple Object Tracking in Molecular Bioimaging , 2007, IPMI.

[22]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[23]  Stanley R. Sternberg,et al.  Biomedical Image Processing , 1983, Computer.

[24]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[25]  Holy,et al.  Microtubule dynamics: Caps, catastrophes, and coupled hydrolysis. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  David Pellman,et al.  Microtubule “Plus-End-Tracking Proteins” The End Is Just the Beginning , 2001, Cell.

[27]  R. Eils,et al.  Quantitative motion analysis and visualization of cellular structures. , 2003, Methods.

[28]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[29]  I. T. Young,et al.  Photobleaching kinetics of fluorescein in quantitative fluorescence microscopy. , 1995, Biophysical journal.

[30]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[32]  Patrick Pérez,et al.  Maintaining multimodality through mixture tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[34]  Chris I. De Zeeuw,et al.  CLASPs Are CLIP-115 and -170 Associating Proteins Involved in the Regional Regulation of Microtubule Dynamics in Motile Fibroblasts , 2001, Cell.

[35]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[36]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[37]  Ilya Grigoriev,et al.  Rab6 regulates transport and targeting of exocytotic carriers. , 2007, Developmental cell.

[38]  Adriaan B. Houtsmuller,et al.  Antiandrogens prevent stable DNA-binding of the androgen receptor , 2005, Journal of Cell Science.

[39]  Roger Y Tsien,et al.  Imagining imaging's future. , 2003, Nature reviews. Molecular cell biology.

[40]  Takeo Kanade,et al.  Online Tracking of Migrating and Proliferating Cells Imaged with Phase-Contrast Microscopy , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[41]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[42]  Hans Driessen,et al.  An efficient particle filter for jump Markov nonlinear systems , 2004 .

[43]  Laurent D. Cohen,et al.  Single quantum dot tracking based on perceptual Grouping using minimal paths in a spatiotemporal volume , 2005, IEEE Transactions on Image Processing.

[44]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[45]  Niels Galjart,et al.  CLASPs attach microtubule plus ends to the cell cortex through a complex with LL5beta. , 2006, Developmental cell.

[46]  M. Unser,et al.  The colored revolution of bioimaging , 2006, IEEE Signal Processing Magazine.