Marker-Less Stage Drift Correction in Super-Resolution Microscopy Using the Single-Cluster PHD Filter

Fluorescence microscopy is a technique which allows the imaging of cellular and intracellular dynamics through the activation of fluorescent molecules attached to them. It is a very important technique because it can be used to analyze the behavior of intracellular processes in vivo in contrast to methods like electron microscopy. There are several challenges related to the extraction of meaningful information from images acquired from optical microscopes due to the low contrast between objects and background and the fact that point-like objects are observed as blurred spots due to the diffraction limit of the optical system. Another consideration is that for the study of intracellular dynamics, multiple particles must be tracked at the same time, which is a challenging task due to problems such as the presence of false positives and missed detections in the acquired data. Additionally, the objective of the microscope is not completely static with respect to the cover slip due to mechanical vibrations or thermal expansions which introduces bias in the measurements. In this paper, a Bayesian approach is used to simultaneously track the locations of objects with different motion behaviors and the stage drift using image data obtained from fluorescence microscopy experiments. Namely, detections are extracted from the acquired frames using image processing techniques, and then these detections are used to accurately estimate the particle positions and simultaneously correct the drift introduced by the motion of the sample stage. A single cluster Probability Hypothesis Density (PHD) filter with object classification is used for the estimation of the multiple target state assuming different motion behaviors. The detection and tracking methods are tested and their performance is evaluated on both simulated and real data.

[1]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[2]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[3]  Karl Rohr,et al.  Deterministic and probabilistic approaches for tracking virus particles in time-lapse fluorescence microscopy image sequences , 2009, Medical Image Anal..

[4]  Richard I. Hartley,et al.  A framework for generating realistic synthetic sequences of total internal reflection fluorescence microscopy images , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[5]  A. Lee Swindlehurst,et al.  IEEE Journal of Selected Topics in Signal Processing Inaugural Issue: [editor-in-chief's message] , 2007, J. Sel. Topics Signal Processing.

[6]  Suliana Manley,et al.  Quantitative evaluation of software packages for single-molecule localization microscopy , 2015, Nature Methods.

[7]  Victoria J Allan,et al.  Light Microscopy Techniques for Live Cell Imaging , 2003, Science.

[8]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[9]  K. Miura Tracking movement in cell biology. , 2005, Advances in biochemical engineering/biotechnology.

[10]  Ba-Ngu Vo,et al.  A Multiple Model Probability Hypothesis Density Tracker for Time-Lapse Cell Microscopy Sequences , 2013, IPMI.

[11]  Wiro J. Niessen,et al.  Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering , 2008, Medical Image Anal..

[12]  Juan M. Corchado,et al.  A particle dyeing approach for track continuity for the SMC-PHD filter , 2014, 17th International Conference on Information Fusion (FUSION).

[13]  Ba-Ngu Vo,et al.  On performance evaluation of multi-object filters , 2008, 2008 11th International Conference on Information Fusion.

[14]  Douglas Lim,et al.  Achieving Accurate Image Registration as the Basis for Super-Resolution , 2003 .

[15]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[16]  Wiro J. Niessen,et al.  A new detection scheme for multiple object tracking in fluorescence microscopy by joint probabilistic data association filtering , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  Daniel E. Clark,et al.  General multi-object filtering and association measure , 2013, 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[18]  Jeremie Houssineau,et al.  PHD filter with diffuse spatial prior on the birth process with applications to GM-PHD filter , 2010, 2010 13th International Conference on Information Fusion.

[19]  Daniel E. Clark,et al.  The single-group PHD filter: An analytic solution , 2011, 14th International Conference on Information Fusion.

[20]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[21]  Y. Bar-Shalom,et al.  Track labeling and PHD filter for multitarget tracking , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[22]  Daniel E. Clark,et al.  A novel approach to image calibration in super-resolution microscopy , 2014, The 2014 International Conference on Control, Automation and Information Sciences (ICCAIS 2014).

[23]  Isabelle Bloch,et al.  Multiple Hypothesis Tracking for Cluttered Biological Image Sequences , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Paul R. Selvin,et al.  Using fixed fiduciary markers for stage drift correction , 2012, Optics express.

[25]  Axel Munk,et al.  Drift estimation for single marker switching based imaging schemes. , 2012, Optics express.

[26]  Y. Bar-Shalom Tracking and data association , 1988 .

[27]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[28]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[29]  Joaquim Salvi,et al.  SLAM With Dynamic Targets via Single-Cluster PHD Filtering , 2013, IEEE Journal of Selected Topics in Signal Processing.

[30]  Yannis Kalaidzidis,et al.  Multiple objects tracking in fluorescence microscopy , 2008, Journal of mathematical biology.

[31]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[32]  Suliana Manley,et al.  Single-particle tracking photoactivated localization microscopy for mapping single-molecule dynamics. , 2010, Methods in Enzymology.

[33]  Daniel E. Clark,et al.  A Unified Approach for Multi-Object Triangulation, Tracking and Camera Calibration , 2014, IEEE Transactions on Signal Processing.

[34]  Michael D. Mason,et al.  Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. , 2006, Biophysical journal.

[35]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[36]  J. Lippincott-Schwartz,et al.  Development and Use of Fluorescent Protein Markers in Living Cells , 2003, Science.

[37]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[38]  Richard I. Hartley,et al.  Application of the IMM-JPDA Filter to Multiple Target Tracking in Total Internal Reflection Fluorescence Microscopy Images , 2012, MICCAI.

[39]  N. Thompson,et al.  Measuring surface dynamics of biomolecules by total internal reflection fluorescence with photobleaching recovery or correlation spectroscopy. , 1981, Biophysical journal.

[40]  Branko Ristic,et al.  Calibration of Multi-Target Tracking Algorithms Using Non-Cooperative Targets , 2013, IEEE Journal of Selected Topics in Signal Processing.

[41]  B. Vo,et al.  Data Association and Track Management for the Gaussian Mixture Probability Hypothesis Density Filter , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[42]  Daniel E. Clark,et al.  Accelerating the Single Cluster PHD Filter with a GPU implementation , 2014, The 2014 International Conference on Control, Automation and Information Sciences (ICCAIS 2014).

[43]  Roberto Brunelli,et al.  Advanced , 1980 .

[44]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[45]  Daniel E. Clark,et al.  Simultaneous tracking of multiple particles and sensor position estimation in fluorescence microscopy images , 2013, 2013 International Conference on Control, Automation and Information Sciences (ICCAIS).