Tracking Colliding Cells In Vivo Microscopy

Leukocyte motion represents an important component in the innate immune response to infection. Intravital microscopy is a powerful tool as it enables in vivo imaging of leukocyte motion. Under inflammatory conditions, leukocytes may exhibit various motion behaviors, such as flowing, rolling, and adhering. With many leukocytes moving at a wide range of speeds, collisions occur. These collisions result in abrupt changes in the motion and appearance of leukocytes. Manual analysis is tedious, error prone, time consuming, and could introduce technician-related bias. Automatic tracking is also challenging due to the noise inherent in in vivo images and abrupt changes in motion and appearance due to collision. This paper presents a method to automatically track multiple cells undergoing collisions by modeling the appearance and motion for each collision state and testing collision hypotheses of possible transitions between states. The tracking results are demonstrated using in vivo intravital microscopy image sequences. We demonstrate that 1) 71% of colliding cells are correctly tracked; (2) the improvement of the proposed method is enhanced when the duration of collision increases; and (3) given good detection results, the proposed method can correctly track 88% of colliding cells. The method minimizes the tracking failures under collisions and, therefore, allows more robust analysis in the study of leukocyte behaviors responding to inflammatory conditions.

[1]  Y. Bar-Shalom Tracking and data association , 1988 .

[2]  Ying Chen,et al.  Automated 5-D analysis of cell migration and interaction in the thymic cortex from time-lapse sequences of 3-D multi-channel multi-photon images. , 2009, Journal of immunological methods.

[3]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[4]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[5]  Min C. Shin,et al.  Liver Microcirculation Analysis by Red Blood Cell Motion Modeling in Intravital Microscopy Images , 2008, IEEE Transactions on Biomedical Engineering.

[6]  Vincent Lepetit,et al.  General constraints for batch Multiple-Target Tracking applied to large-scale videomicroscopy , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Scott T. Acton,et al.  A Monte Carlo approach to rolling leukocyte tracking in vivo , 2006, Medical Image Anal..

[8]  Scott T. Acton,et al.  Level set analysis for leukocyte detection and tracking , 2004, IEEE Transactions on Image Processing.

[9]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[10]  Cor J. Veenman,et al.  Resolving Motion Correspondence for Densely Moving Points , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[12]  Klaus Ley,et al.  Leukocyte Recruitment as Seen by Intravital Microscopy , 2001 .

[13]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[14]  Scott T. Acton,et al.  Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours , 2004, IEEE Transactions on Medical Imaging.

[15]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[16]  Ehud Rivlin,et al.  An automated method for analysis of flow characteristics of circulating particles from in vivo video microscopy , 2005, IEEE Transactions on Medical Imaging.

[17]  Scott T. Acton,et al.  Tracking leukocytes in vivo with shape and size constrained active contours , 2002, IEEE Transactions on Medical Imaging.

[18]  C. Halin,et al.  In vivo imaging of lymphocyte trafficking. , 2005, Annual review of cell and developmental biology.

[19]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[20]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[21]  M. Exley,et al.  To be or not to be NKT: Natural killer T cells in the liver , 2004, Hepatology.