Associating approximate paths and temporal sequences of noisy detections: Application to the recovery of spatio-temporal cancer cell trajectories

In this paper we address the problem of recovering spatio-temporal trajectories of cancer cells in phase contrast video-microscopy where the user provides the paths on which the cells are moving. The paths are purely spatial, without temporal information. To recover the temporal information associated to a given path we propose an approach based on automatic cell detection and on a graph-based shortest path search. The nodes in the graph consist of the projections of the cell detections onto the geometrical cell path. The edges relate nodes which correspond to different frames of the sequence and potentially to the same cell and trajectory. In this directed graph we search for the shortest path and use it to define a temporal parametrization of the corresponding geometrical cell path. An evaluation based on 286 paths of 7 phase contrast microscopy videos shows that our algorithm allows to recover 92% of trajectory points with respect to the associated ground truth. We compare our method with a state-of-the-art algorithm for semi-automated cell tracking in phase contrast microscopy which requires interactively placed starting points for the cells to track. The comparison shows that supporting geometrical paths in combination with our algorithm allow us to obtain more reliable cell trajectories.

[1]  Nathalie Harder,et al.  A benchmark for comparison of cell tracking algorithms , 2014, Bioinform..

[2]  B. Roysam,et al.  Automated Cell Lineage Construction: A Rapid Method to Analyze Clonal Development Established with Murine Neural Progenitor Cells , 2006, Cell cycle.

[3]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[4]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[5]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[6]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[7]  Julian Mattes,et al.  Learning cellular texture features in microscopic cancer cell images for automated cell-detection , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[8]  Jens Rittscher,et al.  Spatio-temporal cell segmentation and tracking for automated screening , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[9]  Joakim Jalden,et al.  Global Linking of Cell Tracks Using the Viterbi Algorithm , 2015, IEEE Transactions on Medical Imaging.

[10]  Vannary Meas-Yedid,et al.  Segmentation and tracking of migrating cells in videomicroscopy with parametric active contours: a tool for cell-based drug testing , 2002, IEEE Transactions on Medical Imaging.

[11]  Robert Kiss,et al.  Can Antimigratory Drugs Be Screened in vitro? A Review of 2D and 3D Assays for the Quantitative Analysis of Cell Migration , 2007 .

[12]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[13]  Philippe Van Ham,et al.  Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes , 2005, IEEE Transactions on Medical Imaging.

[14]  Chia-Lung Hsieh,et al.  Shot-noise limited localization of single 20 nm gold particles with nanometer spatial precision within microseconds. , 2014, Optics express.

[15]  R. Kiss,et al.  Can anti‐migratory drugs be screened in vitro? A review of 2D and 3D assays for the quantitative analysis of cell migration , 2007, Medicinal research reviews.

[16]  O. Debeir,et al.  Automated Cell Tracking and Analysis in Phase-Contrast Videos (iTrack4U): Development of Java Software Based on Combined Mean-Shift Processes , 2013, PloS one.

[17]  Pramod K. Varshney,et al.  Sensor Fusion for Video Surveillance , 2004 .

[18]  Takeo Kanade,et al.  Reliable cell tracking by global data association , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[19]  Natalie L. Catlett,et al.  Divide and multiply: organelle partitioning in yeast. , 2000, Current opinion in cell biology.

[20]  Kostia Robert Bringing Richer Information with Reliability to Automated Traffic Monitoring from the Fusion of Multiple Cameras, Inductive Loops and Road Maps , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[21]  R Chakravorty,et al.  Automated and semi‐automated cell tracking: addressing portability challenges , 2011, Journal of microscopy.

[22]  Xiaobo Zhou,et al.  Multiple Nuclei Tracking Using Integer Programming for Quantitative Cancer Cell Cycle Analysis , 2010, IEEE Transactions on Medical Imaging.

[23]  B. C. Carter,et al.  Cytoplasmic dynein functions as a gear in response to load , 2004, Nature.

[24]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[25]  A. Improved GPS Positioning for Motor Vehicles Through Map Matching , 1997 .

[26]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[28]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[29]  B. C. Carter,et al.  Tracking single particles: a user-friendly quantitative evaluation , 2005, Physical biology.

[30]  Luc Van Gool,et al.  Robust tracking-by-detection using a detector confidence particle filter , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Marc-Emmanuel Bellemare,et al.  Automatic estimation of pelvic organ anatomical references , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Nathalie Harder,et al.  Tracking and quantitative analysis of dynamic movements of cells and particles. , 2010, Cold Spring Harbor protocols.

[33]  Carlos Ortiz-de-Solorzano,et al.  Segmentation and Shape Tracking of Whole Fluorescent Cells Based on the Chan–Vese Model , 2013, IEEE Transactions on Medical Imaging.

[34]  James J. Little,et al.  A Linear Programming Approach for Multiple Object Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Luciano da Fontoura Costa,et al.  An integrated approach to the characterization of cell movement , 2005, Cytometry. Part A : the journal of the International Society for Analytical Cytology.