Multiple Hypothesis Tracking for Cluttered Biological Image Sequences

In this paper, we present a method for simultaneously tracking thousands of targets in biological image sequences, which is of major importance in modern biology. The complexity and inherent randomness of the problem lead us to propose a unified probabilistic framework for tracking biological particles in microscope images. The framework includes realistic models of particle motion and existence and of fluorescence image features. For the track extraction process per se, the very cluttered conditions motivate the adoption of a multiframe approach that enforces tracking decision robustness to poor imaging conditions and to random target movements. We tackle the large-scale nature of the problem by adapting the multiple hypothesis tracking algorithm to the proposed framework, resulting in a method with a favorable tradeoff between the model complexity and the computational cost of the tracking procedure. When compared to the state-of-the-art tracking techniques for bioimaging, the proposed algorithm is shown to be the only method providing high-quality results despite the critically poor imaging conditions and the dense target presence. We thus demonstrate the benefits of advanced Bayesian tracking techniques for the accurate computational modeling of dynamical biological processes, which is promising for further developments in this domain.

[1]  R. Mahler,et al.  PHD filters of higher order in target number , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[3]  Aubrey B. Poore,et al.  A New Lagrangian Relaxation Based Algorithm for a Class of Multidimensional Assignment Problems , 1997, Comput. Optim. Appl..

[4]  A. Trubuil,et al.  Visualization and quantification of vesicle trafficking on a three‐dimensional cytoskeleton network in living cells , 2007, Journal of microscopy.

[5]  Robert J. Dempster,et al.  Demonstration of multiple-hypothesis tracking (MHT) practical real-time implementation feasibility , 2001 .

[6]  Jean-Christophe Olivo-Marin,et al.  Extraction of spots in biological images using multiscale products , 2002, Pattern Recognit..

[7]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[8]  Dmitry Chetverikov,et al.  Feature Point Tracking for Incomplete Trajectories , 1999, Computing.

[9]  Peter Willett,et al.  Set JPDA Filter for Multitarget Tracking , 2011, IEEE Transactions on Signal Processing.

[10]  R.J. Evans,et al.  Target Existence Based MHT , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[11]  P. Sorger,et al.  Automatic fluorescent tag detection in 3D with super‐resolution: application to the analysis of chromosome movement , 2002, Journal of microscopy.

[12]  M. Unser,et al.  The colored revolution of bioimaging , 2006, IEEE Signal Processing Magazine.

[13]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[14]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[15]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[16]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[17]  Ning Li,et al.  Target perceivability and its applications , 2001, IEEE Trans. Signal Process..

[18]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[19]  Der-San Chen,et al.  Applied Integer Programming: Modeling and Solution , 2010 .

[20]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[21]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[22]  X. Zhuang,et al.  Virus trafficking – learning from single-virus tracking , 2007, Nature Reviews Microbiology.

[23]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[24]  C. Morefield Application of 0-1 integer programming to multitarget tracking problems , 1977 .

[25]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[26]  Peter Willett,et al.  Shooting two birds with two bullets: How to find Minimum Mean OSPA estimates , 2010, 2010 13th International Conference on Information Fusion.

[27]  K. Jacobson,et al.  Single-particle tracking: applications to membrane dynamics. , 1997, Annual review of biophysics and biomolecular structure.

[28]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  J. Vermaak,et al.  A unifying framework for multi-target tracking and existence , 2005, 2005 7th International Conference on Information Fusion.

[30]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[31]  X. R. Li,et al.  Tracker design based on target perceivability , 2001 .

[32]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.

[33]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[34]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[35]  Wiro J. Niessen,et al.  Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering , 2008, Medical Image Anal..

[36]  Laurent D. Cohen,et al.  Single quantum dot tracking based on perceptual Grouping using minimal paths in a spatiotemporal volume , 2005, IEEE Transactions on Image Processing.

[37]  Branko Ristic,et al.  A Metric for Performance Evaluation of Multi-Target Tracking Algorithms , 2011, IEEE Transactions on Signal Processing.

[38]  Ba-Ngu Vo,et al.  On performance evaluation of multi-object filters , 2008, 2008 11th International Conference on Information Fusion.

[39]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[40]  Jean-Christophe Olivo-Marin,et al.  A dual role for actin and microtubule cytoskeleton in the transport of Golgi units from the nurse cells to the oocyte across ring canals. , 2009, Molecular biology of the cell.

[41]  S. Shorte,et al.  Quantitative four-dimensional tracking of cytoplasmic and nuclear HIV-1 complexes , 2006, Nature Methods.