Global Linking of Cell Tracks Using the Viterbi Algorithm

Automated tracking of living cells in microscopy image sequences is an important and challenging problem. With this application in mind, we propose a global track linking algorithm, which links cell outlines generated by a segmentation algorithm into tracks. The algorithm adds tracks to the image sequence one at a time, in a way which uses information from the complete image sequence in every linking decision. This is achieved by finding the tracks which give the largest possible increases to a probabilistically motivated scoring function, using the Viterbi algorithm. We also present a novel way to alter previously created tracks when new tracks are created, thus mitigating the effects of error propagation. The algorithm can handle mitosis, apoptosis, and migration in and out of the imaged area, and can also deal with false positives, missed detections, and clusters of jointly segmented cells. The algorithm performance is demonstrated on two challenging datasets acquired using bright-field microscopy, but in principle, the algorithm can be used with any cell type and any imaging technique, presuming there is a suitable segmentation algorithm.

[1]  Jean-Marc Odobez,et al.  Evaluating Multi-Object Tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[2]  G. W. Pulford,et al.  MAP estimation of target manoeuvre sequence with the expectation-maximization algorithm , 2002 .

[3]  Takeo Kanade,et al.  Cell image analysis: Algorithms, system and applications , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[4]  Andrew R. Cohen,et al.  Computational prediction of neural progenitor cell fates , 2010, Nature Methods.

[5]  Yair Barniv,et al.  Dynamic Programming Solution for Detecting Dim Moving Targets , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[6]  I. Smal,et al.  Tracking in cell and developmental biology. , 2009, Seminars in cell & developmental biology.

[7]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[8]  Timm Schroeder,et al.  Probing cellular processes by long-term live imaging – historic problems and current solutions , 2013, Journal of Cell Science.

[9]  Nathalie Harder,et al.  A benchmark for comparison of cell tracking algorithms , 2014, Bioinform..

[10]  Takeo Kanade,et al.  Automatic cell tracking applied to analysis of cell migration in wound healing assay , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Xiaobo Zhou,et al.  Multiple Nuclei Tracking Using Integer Programming for Quantitative Cancer Cell Cycle Analysis , 2010, IEEE Transactions on Medical Imaging.

[12]  S. Thrun,et al.  Substrate Elasticity Regulates Skeletal Muscle Stem Cell Self-Renewal in Culture , 2010, Science.

[13]  Jens Rittscher,et al.  Spatio-temporal cell segmentation and tracking for automated screening , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[15]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[16]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[17]  B. Roysam,et al.  Automated Cell Lineage Construction: A Rapid Method to Analyze Clonal Development Established with Murine Neural Progenitor Cells , 2006, Cell cycle.

[18]  Paul W. Fieguth,et al.  Probabilistic Model-Based Cell Tracking , 2006, Int. J. Biomed. Imaging.

[19]  Jean-Christophe Olivo-Marin,et al.  On the digital trail of mobile cells , 2006, IEEE Signal Processing Magazine.

[20]  Vannary Meas-Yedid,et al.  Segmentation and tracking of migrating cells in videomicroscopy with parametric active contours: a tool for cell-based drug testing , 2002, IEEE Transactions on Medical Imaging.

[21]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[22]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[23]  Carl M. Harris,et al.  Fundamentals of queueing theory , 1975 .

[24]  G W Pulford,et al.  Multihypothesis Viterbi Data Association: Algorithm Development and Assessment , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[26]  H. Blau,et al.  Primary mouse myoblast purification, characterization, and transplantation for cell-mediated gene therapy , 1994, The Journal of cell biology.

[27]  Takeo Kanade,et al.  Mitosis detection for stem cell tracking in phase-contrast microscopy images , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Isabelle Bloch,et al.  Multiple Hypothesis Tracking for Cluttered Biological Image Sequences , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[30]  Michael Unser,et al.  Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics , 2005, IEEE Transactions on Image Processing.

[31]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[32]  Shin-Ichi Nishikawa,et al.  Continuous single-cell imaging of blood generation from haemogenic endothelium , 2009, Nature.

[33]  D. Rapoport,et al.  A Novel Validation Algorithm Allows for Automated Cell Tracking and the Extraction of Biologically Meaningful Parameters , 2011, PloS one.

[34]  Kenong Wu,et al.  Live cell image segmentation , 1995, IEEE Transactions on Biomedical Engineering.

[35]  Philipp J. Keller,et al.  Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet Microscopy , 2008, Science.

[36]  Pascal Fua,et al.  Robust People Tracking with Global Trajectory Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[37]  Margrit Betke,et al.  Cell morphology classification and clutter mitigation in phase-contrast microscopy images using machine learning , 2011, Machine Vision and Applications.

[38]  H. Horvitz,et al.  Genetic control of programmed cell death in the nematode C. elegans , 1986, Cell.

[39]  Takeo Kanade,et al.  Reliably Tracking Partially Overlapping Neural Stem Cells in DIC Microscopy Image Sequences , 2009 .

[40]  Takeo Kanade,et al.  Reliable cell tracking by global data association , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[41]  Joakim Jaldén,et al.  A batch algorithm using iterative application of the Viterbi algorithm to track cells and construct cell lineages , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[42]  Carlos Ortiz-de-Solorzano,et al.  Segmentation and Shape Tracking of Whole Fluorescent Cells Based on the Chan–Vese Model , 2013, IEEE Transactions on Medical Imaging.

[43]  J. Sulston,et al.  The embryonic cell lineage of the nematode Caenorhabditis elegans. , 1983, Developmental biology.

[44]  Xiaobo Zhou,et al.  Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy , 2006, IEEE Transactions on Biomedical Engineering.

[45]  Nathalie Harder,et al.  Tracking and quantitative analysis of dynamic movements of cells and particles. , 2010, Cold Spring Harbor protocols.

[46]  Jean-Christophe Olivo-Marin,et al.  3-D Active Meshes: Fast Discrete Deformable Models for Cell Tracking in 3-D Time-Lapse Microscopy , 2011, IEEE Transactions on Image Processing.

[47]  Charless C. Fowlkes,et al.  Globally-optimal greedy algorithms for tracking a variable number of objects , 2011, CVPR 2011.

[48]  R. Durbin,et al.  Phenotypic profiling of the human genome by time-lapse microscopy reveals cell division genes , 2010, Nature.