Multi-object filtering with second-order moment statistics

The focus of this work lies on multi-object estimation techniques, in particular the Probability Hypothesis Density (PHD) filter and its variations. The PHD filter is a recursive, closed-form estimation technique which tracks a population of objects as a group, hence avoiding the combinatorics of data association and therefore yielding a powerful alternative to methods like Multi-Hypothesis Tracking (MHT). Its relatively low computational complexity stems from strong modelling assumptions which have been relaxed in the Cardinalized PHD (CPHD) filter to gain more flexibility, but at a much higher computational cost. We are concerned with the development of two suitable alternatives which give a compromise between the simplicity and elegance of the PHD filter and the versatility of the CPHD filter. The first alternative generalises the clutter model of the PHD filter, leading to more accurate estimation results in the presence of highly variable numbers of false alarms; the second alternative provides a closed-form recursion of a second-order PHD filter that propagates variance information along with the target intensity, thus providing more information than the PHD filter while keeping a much lower computational complexity than the CPHD filter. The discussed filters are applied on simulated data, furthermore their practicality is demonstrated on live-cell super-resolution microscopy images to provide powerful techniques for molecule and cell tracking, stage drift estimation and estimation of background noise.

[1]  Stuart A. Klugman,et al.  Loss Models: From Data to Decisions , 1998 .

[2]  Daniel E. Clark,et al.  Joint multi-object and clutter rate estimation with the single-cluster PHD filter , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[3]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Daniel E. Clark,et al.  A novel approach to image calibration in super-resolution microscopy , 2014, The 2014 International Conference on Control, Automation and Information Sciences (ICCAIS 2014).

[5]  Jason L. Williams Hybrid Poisson and multi-Bernoulli filters , 2012, 2012 15th International Conference on Information Fusion.

[6]  Ba-Ngu Vo,et al.  The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations , 2009, IEEE Transactions on Signal Processing.

[7]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[8]  M. Ulmke,et al.  "Spooky Action at a Distance" in the Cardinalized Probability Hypothesis Density Filter , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[9]  O. Nikodým Sur une généralisation des intégrales de M. J. Radon , 1930 .

[10]  Daniel E. Clark,et al.  A Second-Order PHD Filter With Mean and Variance in Target Number , 2017, IEEE Transactions on Signal Processing.

[11]  Murat Üney,et al.  Regional Variance for Multi-Object Filtering , 2013, IEEE Transactions on Signal Processing.

[12]  Dietrich Fränken,et al.  Missed detection problems in the cardinalized probability hypothesis density filter , 2008, 2008 11th International Conference on Information Fusion.

[13]  Daniel E. Clark,et al.  General multi-object filtering and association measure , 2013, 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[14]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[15]  Y. Bar-Shalom,et al.  Track labeling and PHD filter for multitarget tracking , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Juan M. Corchado,et al.  A particle dyeing approach for track continuity for the SMC-PHD filter , 2014, 17th International Conference on Information Fusion (FUSION).

[17]  Lei Yang,et al.  Automated single particle detection and tracking for large microscopy datasets , 2016, Royal Society Open Science.

[18]  Daniel E. Clark,et al.  Faà di Bruno’s formula and spatial cluster modelling , 2013 .

[19]  Roy L. Streit,et al.  Bayes derivation of multitarget intensity filters , 2008, 2008 11th International Conference on Information Fusion.

[20]  Roy L. Streit The Probability Generating Functional for Finite Point Processes, and Its Application to the Comparison of PHD and Intensity Filters , 2013, J. Adv. Inf. Fusion.

[21]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[22]  Daniel E. Clark,et al.  Observing the Dynamics of Waterborne Pathogens for Assessing the Level of Contamination , 2015, 2015 Sensor Signal Processing for Defence (SSPD).

[23]  Jason L. Williams,et al.  An Efficient, Variational Approximation of the Best Fitting Multi-Bernoulli Filter , 2014, IEEE Transactions on Signal Processing.

[24]  T. Poggio,et al.  A Contour-Based Moving Object Detection and Tracking , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[25]  Daniel E. Clark,et al.  A PHD filter with negative binomial clutter , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[26]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[27]  Daniel E. Clark,et al.  A few calculus rules for chain differentials , 2015, 1506.08626.

[28]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[29]  Branko Ristic,et al.  Calibration of tracking systems using detections from non-cooperative targets , 2012, 2012 Workshop on Sensor Data Fusion: Trends, Solutions, Applications (SDF).

[30]  Joaquim Salvi,et al.  SLAM With Dynamic Targets via Single-Cluster PHD Filtering , 2013, IEEE Journal of Selected Topics in Signal Processing.

[31]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[32]  Anthony Swain,et al.  Group and extended target tracking with the Probability Hypothesis Density filter , 2013 .

[33]  Harry H. Panjer,et al.  Recursive Evaluation of a Family of Compound Distributions , 1981, ASTIN Bulletin.

[34]  Daniel E. Clark,et al.  Faà Di Bruno's formula and volterra series , 2014, 2014 IEEE Workshop on Statistical Signal Processing (SSP).

[35]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[36]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[37]  S. Hell,et al.  Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopy. , 1994, Optics letters.

[38]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[39]  Daniel E. Clark,et al.  Single-cluster PHD filter methods for joint multi-object filtering and parameter estimation , 2017 .

[40]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[41]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[42]  Fredrik Gustafsson,et al.  Track-before-detect algorithm for tracking extended targets , 2006 .

[43]  P. Moral Nonlinear filtering : Interacting particle resolution , 1997 .

[44]  Pierre Bernhard,et al.  Chain differentials with an application to the mathematical fear operator , 2005 .

[45]  Xiangang Luo,et al.  Surface plasmon resonant interference nanolithography technique , 2004 .

[46]  Ba-Ngu Vo,et al.  The para-normal Bayes multi-target filter and the spooky effect , 2012, 2012 15th International Conference on Information Fusion.

[47]  Ronald P. S. Mahler,et al.  Advances in Statistical Multisource-Multitarget Information Fusion , 2014 .

[48]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[49]  N. Fang,et al.  Sub–Diffraction-Limited Optical Imaging with a Silver Superlens , 2005, Science.

[50]  N. Gordon,et al.  International Conference on Information Fusion ( FUSION ) A Comparison of Particle Filters for Recursive Track-before-detect , 2006 .

[51]  Martin David Adams,et al.  Multifeature-based importance weighting for the PHD SLAM filter , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[52]  R. Mahler,et al.  PHD filters of higher order in target number , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[53]  James S. Duncan,et al.  Tracking Clathrin Coated Pits with a Multiple Hypothesis Based Method , 2010, MICCAI.

[54]  Michael Fackler Panjer class united – one formula for the Poisson , Binomial , and Negative Binomial distribution , 2009 .

[55]  Branko Ristic,et al.  Calibration of Multi-Target Tracking Algorithms Using Non-Cooperative Targets , 2013, IEEE Journal of Selected Topics in Signal Processing.

[56]  Daniel E. Clark,et al.  Faa di Bruno's formula for chain differentials , 2013, 1310.2833.

[57]  D. Stoyan,et al.  Statistical Analysis and Modelling of Spatial Point Patterns , 2008 .

[58]  Branko Ristic,et al.  Particle filter for joint estimation of multi-object dynamic state and multi-sensor bias , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[59]  Pina Gruden,et al.  Automated tracking of dolphin whistles using Gaussian mixture probability hypothesis density filters. , 2016, The Journal of the Acoustical Society of America.

[60]  Daniel E. Clark,et al.  Marker-Less Stage Drift Correction in Super-Resolution Microscopy Using the Single-Cluster PHD Filter , 2016, IEEE Journal of Selected Topics in Signal Processing.

[61]  Anthony J. Yezzi,et al.  Tracking With Sobolev Active Contours , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[62]  Wolfgang Koch,et al.  The Pointillist Family of Multitarget Tracking Filters , 2015, 1505.08000.

[63]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[64]  Jeremie Houssineau,et al.  Representation and estimation of stochastic populations , 2015 .

[65]  Y. Bar-Shalom,et al.  Probability hypothesis density filter for multitarget multisensor tracking , 2005, 2005 7th International Conference on Information Fusion.

[66]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[67]  Ronald Mahler,et al.  PHD filters of second order in target number , 2006, SPIE Defense + Commercial Sensing.

[68]  E. J. Ambrose A Surface Contact Microscope for the study of Cell Movements , 1956, Nature.

[69]  Cyrill Stachniss,et al.  Simultaneous Localization and Mapping , 2016, Springer Handbook of Robotics, 2nd Ed..

[70]  Daniel E. Clark,et al.  The CPHD Filter With Target Spawning , 2017, IEEE Transactions on Signal Processing.

[71]  Henning Stahlberg,et al.  Characterization of the motion of membrane proteins using high-speed atomic force microscopy. , 2012, Nature nanotechnology.

[72]  Daniel E. Clark,et al.  A Unified Approach for Multi-Object Triangulation, Tracking and Camera Calibration , 2014, IEEE Transactions on Signal Processing.

[73]  Michael D. Mason,et al.  Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. , 2006, Biophysical journal.

[74]  Daniel E. Clark,et al.  Joint estimation of telescope drift and space object tracking , 2016, 2016 IEEE Aerospace Conference.

[75]  Thomas Boudier,et al.  Software for drift compensation, particle tracking and particle analysis of high‐speed atomic force microscopy image series , 2012, Journal of molecular recognition : JMR.

[76]  David A. Wilkinson,et al.  Simplified Multitarget Tracking Using the PHD Filter for Microscopic Video Data , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[77]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[78]  J. Lippincott-Schwartz,et al.  High-density mapping of single-molecule trajectories with photoactivated localization microscopy , 2008, Nature Methods.

[79]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[80]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[81]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[82]  D. Clark,et al.  PHD filter multi-target tracking in 3D sonar , 2005, Europe Oceans 2005.

[83]  J. Zerubia,et al.  Gaussian approximations of fluorescence microscope point-spread function models. , 2007, Applied optics.

[84]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[85]  Stefano Coraluppi,et al.  Recursive track fusion for multi-sensor surveillance , 2004, Inf. Fusion.

[86]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.