Deep neural networks for data association in particle tracking

An essential first step towards understanding intracellular dynamic processes using live-cell time-lapse microscopy imaging is to extract accurate trajectories of all relevant particles in the images. One of the key aspects of this task is to make accurate associations between particle detections across time frames. State-of-the-art methods for this purpose often have many user parameters, sometimes even without a clear biophysical meaning, and/or they use explicit particle motion models that may not reflect reality, making them unfavorable for non-expert users or specific applications. Here we present a novel approach to data association for particle tracking applications based on deep neural networks. Specifically, we propose a recurrent neural network that learns particle behavior from the data, and based on this it determines how to best extend trajectories from one frame to the next. The results of preliminary experiments indicate that our method performs comparable to state-of-the-art data association methods for particle tracking, but with the advantage that it does not require users to tune any parameters.

[1]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[2]  Zhang Yi,et al.  Cell tracking using deep neural networks with multi-task learning , 2017, Image Vis. Comput..

[3]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[4]  Erik Meijering,et al.  Automated Analysis of Intracellular Dynamic Processes. , 2017, Methods in molecular biology.

[5]  Konrad Schindler,et al.  Online Multi-Target Tracking Using Recurrent Neural Networks , 2016, AAAI.

[6]  Yi Yang,et al.  Multiple dense particle tracking in fluorescence microscopy images based on multidimensional assignment. , 2011, Journal of structural biology.

[7]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[8]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[9]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[10]  Zhihai He,et al.  Spatially supervised recurrent convolutional neural networks for visual object tracking , 2016, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[11]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[12]  Karl Rohr,et al.  Tracking virus particles in fluorescence microscopy images using two-step multi-frame association , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[13]  Prabhat,et al.  The HEP.TrkX Project: deep neural networks for HL-LHC online and offline tracking , 2017 .

[14]  Erik H. W. Meijering,et al.  Quantitative comparison of multiframe data association techniques for particle tracking in time-lapse fluorescence microscopy , 2015, Medical Image Anal..

[15]  Konrad Schindler,et al.  Learning by Tracking: Siamese CNN for Robust Target Association , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[17]  Samuel K. Lai,et al.  Deep neural networks automate detection for tracking of submicron scale particles in 2D and 3D , 2017 .

[18]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[19]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[20]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.