Piecewise-Stationary Motion Modeling and Iterative Smoothing to Track Heterogeneous Particle Motions in Dense Environments

One of the major challenges in multiple particle tracking is the capture of extremely heterogeneous movements of objects in crowded scenes. The presence of numerous assignment candidates in the expected range of particle motion makes the tracking ambiguous and induces false positives. Lowering the ambiguity by reducing the search range, on the other hand, is not an option, as this would increase the rate of false negatives. We propose here a piecewise-stationary motion model (PMM) for the particle transport along an iterative smoother that exploits recursive tracking in multiple rounds in forward and backward temporal directions. By fusing past and future information, our method, termed PMMS, can recover fast transitions from freely or confined diffusive to directed motions with linear time complexity. To avoid false positives, we complemented recursive tracking with a robust inline estimator of the search radius for assignment (a.k.a. gating), where past and future information are exploited using only two frames at each optimization step. We demonstrate the improvement of our technique on simulated data especially the impact of density, variation in frame to frame displacements, and motion switching probability. We evaluated our technique on the 2D particle tracking challenge dataset published by Chenouard et al. in 2014. Using high SNR to focus on motion modeling challenges, we show superior performance at high particle density. On biological applications, our algorithm allows us to quantify the extremely small percentage of motor-driven movements of fluorescent particles along microtubules in a dense field of unbound, diffusing particles. We also show with virus imaging that our algorithm can cope with a strong reduction in recording frame rate while keeping the same performance relative to methods relying on fast sampling.

[1]  A. Sergé,et al.  Dynamic multiple-target tracing to probe spatiotemporal cartography of cell membranes , 2008, Nature Methods.

[2]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[3]  Sandra L Schmid,et al.  Advances in analysis of low signal-to-noise images link dynamin and AP2 to the functions of an endocytic checkpoint. , 2013, Developmental cell.

[4]  Brian T Helfand,et al.  Intermediate filaments are dynamic and motile elements of cellular architecture , 2004, Journal of Cell Science.

[5]  T. Lagache,et al.  Physical principles and models describing intracellular virus particle dynamics. , 2009, Current opinion in microbiology.

[6]  Joakim Jaldén,et al.  Tracking of non-brownian particles using the Viterbi algorithm , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[7]  Laurent D. Cohen,et al.  A multiple target approach for single quantum dot tracking , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[8]  Robert D. Goldman,et al.  Rapid Movements of Vimentin on Microtubule Tracks: Kinesin-dependent Assembly of Intermediate Filament Networks , 1998, The Journal of cell biology.

[9]  P. Jung,et al.  Axonal Transport of Neurofilaments: A Single Population of Intermittently Moving Polymers , 2012, The Journal of Neuroscience.

[10]  P. Sorger,et al.  Automatic fluorescent tag localization II: improvement in super‐resolution by relative tracking , 2003, Journal of microscopy.

[11]  Joakim Jalden,et al.  Global Linking of Cell Tracks Using the Viterbi Algorithm , 2015, IEEE Transactions on Medical Imaging.

[12]  Erik H. W. Meijering,et al.  Quantitative comparison of multiframe data association techniques for particle tracking in time-lapse fluorescence microscopy , 2015, Medical Image Anal..

[13]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[14]  Charles Kervrann,et al.  A Guided Tour of Selected Image Processing and Analysis Methods for Fluorescence and Electron Microscopy , 2016, IEEE Journal of Selected Topics in Signal Processing.

[15]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[16]  Joakim Jaldén,et al.  A batch algorithm using iterative application of the Viterbi algorithm to track cells and construct cell lineages , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[17]  Christoph J. Burckhardt,et al.  The Dynactin Complex Enhances the Speed of Microtubule-Dependent Motions of Adenovirus Both Towards and Away from the Nucleus , 2011, Viruses.

[18]  M. Saxton,et al.  Single-particle tracking: models of directed transport. , 1994, Biophysical journal.

[19]  Wiro J. Niessen,et al.  A new detection scheme for multiple object tracking in fluorescence microscopy by joint probabilistic data association filtering , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[20]  Charles Kervrann,et al.  Multiple-target tracking of 3D fluorescent objects based on simulated annealing , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[21]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[22]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[23]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[24]  Y. Kalaidzidis Intracellular objects tracking. , 2007, European journal of cell biology.

[25]  Karl Rohr,et al.  Deterministic and probabilistic approaches for tracking virus particles in time-lapse fluorescence microscopy image sequences , 2009, Medical Image Anal..

[26]  Nicolas Chenouard,et al.  An algorithm for piecewise-constant velocity estimation and application to particle trajectories in microscopy , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[27]  James S. Duncan,et al.  A Novel Multiple Hypothesis Based Particle Tracking Method for Clathrin Mediated Endocytosis Analysis Using Fluorescence Microscopy , 2014, IEEE Transactions on Image Processing.

[28]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[29]  Petros Koumoutsakos,et al.  A novel supervised trajectory segmentation algorithm identifies distinct types of human adenovirus motion in host cells. , 2007, Journal of structural biology.

[30]  Cheng Fang,et al.  Axonal transport analysis using Multitemporal Association Tracking , 2012, Int. J. Comput. Biol. Drug Des..

[31]  Yannis Kalaidzidis,et al.  Multiple objects tracking in fluorescence microscopy , 2008, Journal of mathematical biology.

[32]  Isabelle Bloch,et al.  Multiple Hypothesis Tracking for Cluttered Biological Image Sequences , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[34]  Charles Kervrann,et al.  Tracking Growing Axons by Particle Filtering in 3D + t Fluorescent Two-Photon Microscopy Images , 2012, ACCV.

[35]  Myriam Vimond,et al.  An adaptive statistical test to detect non Brownian diffusion from particle trajectories , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[36]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[37]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[38]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[39]  Bo Zhang,et al.  Tracking of multiple fluorescent biological objects in three dimensional video microscopy , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[40]  M K Cheezum,et al.  Quantitative comparison of algorithms for tracking single fluorescent particles. , 2001, Biophysical journal.

[41]  Karl Rohr,et al.  Tracking Virus Particles in Fluorescence Microscopy Images Using Multi-Scale Detection and Multi-Frame Association , 2015, IEEE Transactions on Image Processing.

[42]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[43]  Karl Rohr,et al.  Motion analysis of receptors and ligands in high resolution fluorescence microscopy images , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[44]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[45]  Jitendra Tugnait Detection and estimation for abruptly changing systems , 1981, CDC 1981.

[46]  Jean-Christophe Olivo-Marin,et al.  Analysis of moving biological objects in video microscopy sequences , 1999, Electronic Imaging.

[47]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.

[48]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[49]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[50]  Ba-Ngu Vo,et al.  Multi-Target Tracking With Time-Varying Clutter Rate and Detection Profile: Application to Time-Lapse Cell Microscopy Sequences , 2015, IEEE Transactions on Medical Imaging.

[51]  U. Greber,et al.  Drifting motions of the adenovirus receptor CAR and immobile integrins initiate virus uncoating and membrane lytic protein exposure. , 2011, Cell host & microbe.

[52]  Karl Rohr,et al.  Tracking Multiple Particles in Fluorescence Time-Lapse Microscopy Images via Probabilistic Data Association , 2015, IEEE Transactions on Medical Imaging.

[53]  G. Kitagawa The two-filter formula for smoothing and an implementation of the Gaussian-sum smoother , 1994 .

[54]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[55]  G. A. Ackerson,et al.  On state estimation in switching environments , 1968 .

[56]  Richard I. Hartley,et al.  Application of the IMM-JPDA Filter to Multiple Target Tracking in Total Internal Reflection Fluorescence Microscopy Images , 2012, MICCAI.