Distributed Multi-Object Tracking Under Limited Field of View Sensors

We consider the challenging problem of tracking multiple objects using a distributed network of sensors. In the practical setting of nodes with limited field of views (FoVs), computing power and communication resources, we develop a novel distributed multi-object tracking algorithm. To accomplish this, we first formalise the concept of label consistency, determine a sufficient condition to achieve it and develop a novel label consensus approach that reduces label inconsistency caused by objects’ movements from one node’s limited FoV to another. Second, we develop a distributed multi-object fusion algorithm that fuses local multi-object state estimates instead of local multi-object densities. This algorithm: i) requires significantly less processing time than multi-object density fusion methods; ii) achieves better tracking accuracy by considering Optimal Sub-Pattern Assignment (OSPA) tracking errors over several scans rather than a single scan; iii) is agnostic to local multi-object tracking techniques, and only requires each node to provide a set of estimated tracks. Thus, it is not necessary to assume that the nodes maintain multi-object densities, and hence the fusion outcomes do not modify local multi-object densities. Numerical experiments demonstrate our proposed solution’s real-time computational efficiency and accuracy compared to state-of-the-art solutions in challenging scenarios.

[1]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[2]  N. Tomizawa,et al.  On some techniques useful for solution of transportation network problems , 1971, Networks.

[3]  Richard M. Karp,et al.  Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems , 1972, Combinatorial Optimization.

[4]  D. Reid An algorithm for tracking multiple targets , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[5]  Yaakov Bar-Shalom,et al.  The Effect of the Common Process Noise on the Two-Sensor Fused-Track Covariance , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Yaakov Bar-Shalom,et al.  Multitarget-multisensor tracking: Advanced applications , 1989 .

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Stelios C. A. Thomopoulos,et al.  Distributed Fusion Architectures and Algorithms for Target Tracking , 1997, Proc. IEEE.

[10]  Y. Bar-Shalom,et al.  On optimal track-to-track fusion , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Ronald P. S. Mahler,et al.  Optimal/robust distributed data fusion: a unified approach , 2000, SPIE Defense + Commercial Sensing.

[12]  Kuo-Chu Chang,et al.  Architectures and algorithms for track association and fusion , 2000 .

[13]  M. Hurley An information theoretic justification for covariance intersection and its generalization , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[14]  Chee-Yee Chong,et al.  Track association and track fusion with nondeterministic target dynamics , 2002 .

[15]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[16]  Chee-Yee Chong,et al.  Track-to-track association metric I.I.D.-non-poisson cases , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[17]  Ronald P. S. Mahler,et al.  Multitarget miss distance via optimal assignment , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[19]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.

[20]  M. Vetterli Distributed signal processing for sensor networks , 2005, IEEE 6th Workshop on Signal Processing Advances in Wireless Communications, 2005..

[21]  Zhi-Quan Luo,et al.  Distributed signal processing in sensor networks [from the guest Editors] , 2006, IEEE Signal Processing Magazine.

[22]  Jeffrey K. Uhlmann,et al.  Using Exponential Mixture Models for Suboptimal Distributed Data Fusion , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[23]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[24]  R. Mahler,et al.  PHD filters of higher order in target number , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[26]  Lance M. Kaplan,et al.  Assignment costs for multiple sensor track-to-track association , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[27]  Ba-Ngu Vo,et al.  The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations , 2009, IEEE Transactions on Signal Processing.

[28]  Chee-Yee Chong,et al.  Analytical and Computational Evaluation of Scalable Distributed Fusion Algorithms , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[29]  Klaus C. J. Dietmayer,et al.  Generic Centralized Multi Sensor Data Fusion Based on Probabilistic Sensor and Environment Models for Driver Assistance Systems , 2010, IEEE Intelligent Transportation Systems Magazine.

[30]  Daniel E. Clark,et al.  Robust multi-object sensor fusion with unknown correlations , 2010 .

[31]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[32]  Ba-Ngu Vo,et al.  A Random-Finite-Set Approach to Bayesian SLAM , 2011, IEEE Transactions on Robotics.

[33]  Yaakov Bar-Shalom,et al.  Track-to-Track Fusion in Linear and Nonlinear Systems , 2012 .

[34]  Kuo-Chu Chang,et al.  Comparison of track fusion rules and track association metrics , 2012, 2012 15th International Conference on Information Fusion.

[35]  David Suter,et al.  Visual tracking of numerous targets via multi-Bernoulli filtering of image data , 2012, Pattern Recognit..

[36]  Murat Üney,et al.  Distributed Fusion of PHD Filters Via Exponential Mixture Densities , 2013, IEEE Journal of Selected Topics in Signal Processing.

[37]  Ba-Ngu Vo,et al.  Labeled Random Finite Sets and Multi-Object Conjugate Priors , 2013, IEEE Transactions on Signal Processing.

[38]  Ba-Ngu Vo,et al.  A Tutorial on Bernoulli Filters: Theory, Implementation and Applications , 2013, IEEE Transactions on Signal Processing.

[39]  Giorgio Battistelli,et al.  Consensus CPHD Filter for Distributed Multitarget Tracking , 2013, IEEE Journal of Selected Topics in Signal Processing.

[40]  Ba-Ngu Vo,et al.  Labeled Random Finite Sets and the Bayes Multi-Target Tracking Filter , 2013, IEEE Transactions on Signal Processing.

[41]  Giorgio Battistelli,et al.  Kullback-Leibler average, consensus on probability densities, and distributed state estimation with guaranteed stability , 2014, Autom..

[42]  Klaus C. J. Dietmayer,et al.  The Labeled Multi-Bernoulli Filter , 2014, IEEE Transactions on Signal Processing.

[43]  Kuo-Chu Chang,et al.  Performance prediction of feature-aided track-to-track association , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[44]  Wei Yi,et al.  Distributed fusion with multi-Bernoulli filter based on generalized Covariance Intersection , 2015, 2015 IEEE Radar Conference (RadarCon).

[45]  Giorgio Battistelli,et al.  Consensus Labeled Random Finite Set Filtering for Distributed Multi-Object Tracking , 2015, ArXiv.

[46]  Jason L. Williams,et al.  An Efficient, Variational Approximation of the Best Fitting Multi-Bernoulli Filter , 2014, IEEE Transactions on Signal Processing.

[47]  Klaus C. J. Dietmayer,et al.  The Labeled Multi-Bernoulli SLAM Filter , 2015, IEEE Signal Processing Letters.

[48]  Ba-Ngu Vo,et al.  Multi-Target Tracking With Time-Varying Clutter Rate and Detection Profile: Application to Time-Lapse Cell Microscopy Sequences , 2015, IEEE Transactions on Medical Imaging.

[49]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[50]  Manuel Stuebler,et al.  A fast implementation of the Labeled Multi-Bernoulli filter using gibbs sampling , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[51]  Ba-Ngu Vo,et al.  An Efficient Implementation of the Generalized Labeled Multi-Bernoulli Filter , 2016, IEEE Transactions on Signal Processing.

[52]  Javier Bajo,et al.  Clustering for filtering: Multi-object detection and estimation using multiple/massive sensors , 2017, Inf. Sci..

[53]  Ba-Ngu Vo,et al.  OSPA(2): Using the OSPA metric to evaluate multi-target tracking performance , 2017, 2017 International Conference on Control, Automation and Information Sciences (ICCAIS).

[54]  Ba-Ngu Vo,et al.  Performance Evaluation for Large-Scale Multi-Target Tracking Algorithms , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[55]  Giorgio Battistelli,et al.  Robust Distributed Fusion With Labeled Random Finite Sets , 2017, IEEE Transactions on Signal Processing.

[56]  Giorgio Battistelli,et al.  Robust Fusion for Multisensor Multiobject Tracking , 2018, IEEE Signal Processing Letters.

[57]  Juan M. Corchado,et al.  Partial Consensus and Conservative Fusion of Gaussian Mixtures for Distributed PHD Fusion , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[58]  Giorgio Battistelli,et al.  Computationally Efficient Multi-Agent Multi-Object Tracking With Labeled Random Finite Sets , 2019, IEEE Transactions on Signal Processing.

[59]  Lin Gao,et al.  Event-Triggered Distributed Multitarget Tracking , 2019, IEEE Transactions on Signal and Information Processing over Networks.

[60]  Carmine Clemente,et al.  CubeSat-Based Passive Bistatic Radar for Space Situational Awareness: A Feasibility Study , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[61]  Ba Tuong Vo,et al.  A Multi-Scan Labeled Random Finite Set Model for Multi-Object State Estimation , 2018, IEEE Transactions on Signal Processing.

[62]  Juan M. Corchado,et al.  Local-Diffusion-Based Distributed SMC-PHD Filtering Using Sensors With Limited Sensing Range , 2019, IEEE Sensors Journal.

[63]  Murat Üney,et al.  Fusion of Finite-Set Distributions: Pointwise Consistency and Global Cardinality , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[64]  Ba-Tuong Vo,et al.  Multi-Sensor Multi-Object Tracking With the Generalized Labeled Multi-Bernoulli Filter , 2017, IEEE Transactions on Signal Processing.

[65]  Damith Chinthana Ranasinghe,et al.  TrackerBots: Autonomous unmanned aerial vehicle for real‐time localization and tracking of multiple radio‐tagged animals , 2017, J. Field Robotics.

[66]  Q. Pan,et al.  On Arithmetic Average Fusion and Its Application for Distributed Multi-Bernoulli Multitarget Tracking , 2020, IEEE Transactions on Signal Processing.

[67]  Tiancheng Li,et al.  A Parallel Filtering-Communication-Based Cardinality Consensus Approach for Real-Time Distributed PHD Filtering , 2020, IEEE Sensors Journal.

[68]  Fei Chen,et al.  LAVAPilot: Lightweight UAV Trajectory Planner with Situational Awareness for Embedded Autonomy to Track and Locate Radio-tags , 2020, ArXiv.

[69]  Ba-Ngu Vo,et al.  A Solution for Large-Scale Multi-Object Tracking , 2018, IEEE Transactions on Signal Processing.

[70]  Giorgio Battistelli,et al.  Distributed Multi-sensor Multi-view Fusion based on Generalized Covariance Intersection , 2019, Signal Process..

[71]  Wei Yi,et al.  Computationally Efficient Distributed Multi-Sensor Fusion With Multi-Bernoulli Filter , 2019, IEEE Transactions on Signal Processing.

[72]  Giorgio Battistelli,et al.  Multiobject Fusion With Minimum Information Loss , 2019, IEEE Signal Processing Letters.