A multiple hypothesis tracker with interacting feature extraction

The multiple hypothesis tracker (mht) is an optimal tracking method due to the enumeration of all possible measurement-to-track associations. However, its practical implementation is limited by the exponential growth in this enumeration. Feature data, in addition to kinematic measurements, can improve track quality and reduce false tracks. In this paper, a new approach whereby there is an intrinsic interaction between feature extraction and the mht is presented. A measure of the feature extraction quality is input into the measurement-to-track association while the prediction step feeds back information to be used in the next round of feature extraction. The motivation for this interaction between feature extraction and tracking is to improve the performance in both steps. In addition, a track-specific detection probability becomes available to the prior. This prior probability moderates the state covariance growth when measurements are not available for track continuation. This moderation permits growth of the tracking gate when a target is out maneuvering the tracker, while this growth is limited when the target is within the tracking gate but with a low probability of detection. Simulation results demonstrate the benefits of the proposed approach with a small increase in computational load.

[1]  Ba-Ngu Vo,et al.  Bayesian Multi-Object Filtering With Amplitude Feature Likelihood for Unknown Object SNR , 2010, IEEE Transactions on Signal Processing.

[2]  M.L. Miller,et al.  A comparison of two algorithms for determining ranked assignments with application to multitarget tracking and motion correspondence , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[3]  I. Miller.  Probability, Random Variables, and Stochastic Processes , 1966 .

[4]  Y. Bar-Shalom,et al.  Interacting segmentation and tracking of overlapping objects from an image sequence , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[5]  El Segundo.  Joint IMM / MHT Tracking and Identification for Multi-Sensor Ground Target Tracking , .

[6]  Oliver E. Drummond,et al.  Feature, attribute, and classification aided target tracking , 2001 .

[7]  Xiaorong Zhi,et al.  PSNF: a refined strongest neighbor filter for tracking in clutter , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[8]  David Suter,et al.  Visual tracking with automatic motion model switching , 2001, Pattern Recognit..

[9]  Ingemar J. Cox,et al.  An efficient implementation and evaluation of Reid's multiple hypothesis tracking algorithm for visual tracking , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[10]  Oliver E. Drummond.  Tracking and classification with attribute data from multiple legacy sensors , 2005, SPIE Optics + Photonics.

[11]  T. J. Page.  Multivariate Statistics: A Vector Space Approach , 1984 .

[12]  X. R. Li,et al.  The PDF of nearest neighbor measurement and a probabilistic nearest neighbor filter for tracking in clutter , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[13]  M.L. Miller,et al.  Optimizing Murty's ranked assignment method , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Oliver E. Drummond.  Integration of features and attributes into target tracking , 2000, SPIE Defense + Commercial Sensing.

[15]  Y. Bar-Shalom,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[16]  G. V. Keuk.  Multihypothesis tracking using incoherent signal-strength information , 1996 .

[17]  Samuel S. Blackman,et al.  Multiple-Target Tracking with Radar Applications , 1986 .

[18]  Ingemar J. Cox,et al.  Unsupervised learning for mobile robot navigation using probabilistic data association , 1994, COLT 1994.

[19]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.

[20]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[21]  X. R. Li,et al.  Tracking in clutter with strongest neighbor measurements. I. Theoretical analysis , 1998, IEEE Trans. Autom. Control..

[22]  J. Junkins,et al.  Optimal Estimation of Dynamic Systems , 2004 .

[23]  Stephen M. Matechik,et al.  Hue-saturation-value feature analysis for robust ground moving target tracking in color aerial video , 2006, SPIE Defense + Commercial Sensing.

[24]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[25]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[26]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[27]  Henk A. P. Blom,et al.  Interacting multiple model joint probabilistic data association avoiding track coalescence , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[28]  W. Härdle,et al.  Applied Multivariate Statistical Analysis , 2003 .

[29]  Thiagalingam Kirubarajan,et al.  A judicious multiple hypothesis tracker with interacting feature extraction , 2009, Defense + Commercial Sensing.

[30]  Ingemar J. Cox,et al.  On Finding Ranked Assignments With Application to Multi-Target Tracking and Motion Correspondence , 1995 .

[31]  Darko Musicki,et al.  Joint Integrated Probabilistic Data Association - JIPDA , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[32]  Zhijian Hu,et al.  Evaluation of multiple radar target trackers in stressful environments , 1999 .

[33]  Y. Bar-Shalom,et al.  Automatic track formation in clutter with a recursive algorithm , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[34]  Yaakov Bar-Shalom,et al.  Multi-target tracking using joint probabilistic data association , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[35]  Robert Fitzgerald.  Track Biases and Coalescence with Probabilistic Data Association , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[36]  Richard F. Grimmett,et al.  Intelligence, Surveillance, and Reconnaissance (ISR) Acquisition: Issues for Congress , 2012 .

[37]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[38]  Thiagalingam Kirubarajan,et al.  Traffic Surveillance Using IMM/Assignment Estimators , 1999 .

[39]  Oliver E. Drummond.  Attributes in tracking and classification with incomplete data , 2004, SPIE Defense + Commercial Sensing.

[40]  Robin J. Evans,et al.  Integrated probabilistic data association , 1994, IEEE Trans. Autom. Control..

[41]  Sidney C. Port,et al.  Probability, Random Variables, and Stochastic Processes—Second Edition (Athanasios Papoulis) , 1986 .

[42]  M. A. Girshick.  On the Sampling Theory of Roots of Determinantal Equations , 1939 .

[43]  Nikolaos Papanikolopoulos,et al.  Robust target detection and tracking through integration of motion, color, and geometry , 2006, Comput. Vis. Image Underst..

[44]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[45]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[46]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[47]  E. Trucco,et al.  Video Tracking: A Concise Survey , 2006, IEEE Journal of Oceanic Engineering.

[48]  Michael Mertens,et al.  GMTI tracking using signal strength information , 2010, 2010 13th International Conference on Information Fusion.

[49]  Oliver E. Drummond.  Target classification with data from multiple sensors , 2002, SPIE Defense + Commercial Sensing.

[50]  Yaakov Bar-Shalom,et al.  Dimensionless score function for multiple hypothesis tracking , 2007 .

[51]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Y. Bar-Shalom,et al.  Tracking in a cluttered environment with probabilistic data association , 1975, Autom..