Overview of Bayesian sequential Monte Carlo methods for group and extended object tracking

This work presents the current state-of-the-art in techniques for tracking a number of objects moving in a coordinated and interacting fashion. Groups are structured objects characterized with particular motion patterns. The group can be comprised of a small number of interacting objects (e.g. pedestrians, sport players, convoy of cars) or of hundreds or thousands of components such as crowds of people. The group object tracking is closely linked with extended object tracking but at the same time has particular features which differentiate it from extended objects. Extended objects, such as in maritime surveillance, are characterized by their kinematic states and their size or volume. Both group and extended objects give rise to a varying number of measurements and require trajectory maintenance. An emphasis is given here to sequential Monte Carlo (SMC) methods and their variants. Methods for small groups and for large groups are presented, including Markov Chain Monte Carlo (MCMC) methods, the random matrices approach and Random Finite Set Statistics methods. Efficient real-time implementations are discussed which are able to deal with the high dimensionality and provide high accuracy. Future trends and avenues are traced.

[1]  X. Rong Li,et al.  Tracking of extended object or target group using random matrix — Part I: New model and approach , 2012, 2012 15th International Conference on Information Fusion.

[2]  Ronald Mahler,et al.  CPHD and PHD filters for unknown backgrounds I: dynamic data clustering , 2009, Defense + Commercial Sensing.

[3]  J.W. Koch,et al.  Bayesian approach to extended object and cluster tracking using random matrices , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Karl Granström,et al.  On Spawning and Combination of Extended/Group Targets Modeled With Random Matrices , 2013, IEEE Transactions on Signal Processing.

[5]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[6]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[7]  Simon J. Godsill,et al.  Poisson models for extended target and group tracking , 2005, SPIE Optics + Photonics.

[8]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[9]  Andreas Hegyi,et al.  Parallelized Particle and Gaussian Sum Particle Filters for Large-Scale Freeway Traffic Systems , 2012, IEEE Transactions on Intelligent Transportation Systems.

[10]  Gitta Kutyniok,et al.  1 . 2 Sparsity : A Reasonable Assumption ? , 2012 .

[11]  A. Doucet,et al.  Sequential Monte Carlo methods for multitarget filtering with random finite sets , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Avishy Carmi,et al.  Tracking of coordinated groups using marginalised MCMC-based Particle algorithm , 2009, 2009 IEEE Aerospace conference.

[13]  N. G. Best,et al.  Dynamic conditional independence models and Markov chain Monte Carlo methods , 1997 .

[14]  Erol Sahin,et al.  Steering self-organized robot flocks through externally guided individuals , 2010, Neural Computing and Applications.

[15]  Ba-Ngu Vo,et al.  Robust Multi-Bernoulli Filtering , 2013, IEEE Journal of Selected Topics in Signal Processing.

[16]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[17]  Hans Driessen,et al.  Multitarget tracking with Interacting Population-based MCMC-PF , 2012, 2012 15th International Conference on Information Fusion.

[18]  Simon J. Godsill,et al.  Sequential Monte Carlo framework for extended object tracking , 2005 .

[19]  Roy L. Streit,et al.  Sequential Monte Carlo method for the iFilter , 2011, 14th International Conference on Information Fusion.

[20]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[21]  Matthew N. Dailey,et al.  Multiple human tracking in high-density crowds , 2009, Image Vis. Comput..

[22]  Roy L. Streit,et al.  Poisson Point Processes , 2010 .

[23]  Christian Lundquist,et al.  A Gaussian mixture PHD filter for extended target tracking , 2010, 2010 13th International Conference on Information Fusion.

[24]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[25]  Andreas Hegyi,et al.  Freeway traffic estimation within particle filtering framework , 2007, Autom..

[26]  Lennart Svensson,et al.  A CPHD Filter for Tracking With Spawning Models , 2013, IEEE Journal of Selected Topics in Signal Processing.

[27]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[28]  Alan S. Willsky,et al.  Hierarchical Dirichlet processes for tracking maneuvering targets , 2007, 2007 10th International Conference on Information Fusion.

[29]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

[30]  Lyudmila Mihaylova,et al.  A novel Sequential Monte Carlo approach for extended object tracking based on border parameterisation , 2011, 14th International Conference on Information Fusion.

[31]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[32]  Jean Gao,et al.  Tracking multiple interacting subcellular structure by sequential Monte Carlo method , 2009, Int. J. Data Min. Bioinform..

[33]  R. Mahler,et al.  PHD filters of higher order in target number , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[34]  A. Hero,et al.  Multitarget tracking using the joint multitarget probability density , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[35]  Fredrik Gustafsson,et al.  Particle Filtering: The Need for Speed , 2010, EURASIP J. Adv. Signal Process..

[36]  Ba-Ngu Vo,et al.  Convergence Analysis of the Gaussian Mixture PHD Filter , 2007, IEEE Transactions on Signal Processing.

[37]  Lyudmila Mihaylova,et al.  Extended Object Tracking Using Monte Carlo Methods , 2008, IEEE Transactions on Signal Processing.

[38]  Andrea Cavallaro,et al.  Multi-camera tracking using a Multi-Goal Social Force Model , 2013, Neurocomputing.

[39]  Daniel Cremers,et al.  Box-particle probability hypothesis density filtering , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[40]  Ba-Ngu Vo,et al.  Adaptive Target Birth Intensity for PHD and CPHD Filters , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[41]  Shihong Lao,et al.  Multiple Player Tracking in Sports Video: A Dual-Mode Two-Way Bayesian Inference Approach With Progressive Observation Modeling , 2011, IEEE Transactions on Image Processing.

[42]  G. Dimitrakopoulos,et al.  Intelligent Transportation Systems , 2010, IEEE Vehicular Technology Magazine.

[43]  Dietrich Fränken,et al.  Tracking of Extended Objects and Group Targets Using Random Matrices , 2008, IEEE Transactions on Signal Processing.

[44]  Branko Ristic,et al.  Particle Filters for Random Set Models , 2013 .

[45]  X. R. Li,et al.  Extended target tracking using star-convex model with nonlinear inequality constraints , 2012, Proceedings of the 31st Chinese Control Conference.

[46]  Jack Li,et al.  Models and Algorithms for Detection and Tracking of Coordinated Groups , 2007, 2008 IEEE Aerospace Conference.

[47]  Tomoyuki Higuchi,et al.  A dynamic grouping strategy for implementation of the particle filter on a massively parallel computer , 2010, 2010 13th International Conference on Information Fusion.

[48]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[49]  Simon J. Godsill,et al.  Tracking of multiple contaminant clouds , 2009, 2009 12th International Conference on Information Fusion.

[50]  Wolfgang Koch,et al.  Probabilistic tracking of multiple extended targets using random matrices , 2010, Defense + Commercial Sensing.

[51]  P. J. van Leeuwen,et al.  A variance-minimizing filter for large-scale applications , 2003 .

[52]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[53]  Ronald P. S. Mahler,et al.  Random Set Theory for Target Tracking and Identification , 2001 .

[54]  Uwe D. Hanebeck,et al.  Extended Object and Group Tracking: A Comparison of Random Matrices and Random Hypersurface Models , 2010, GI Jahrestagung.

[55]  Sandra Zilles,et al.  Learning Models of Activities Involving Interacting Objects , 2013, IDA.

[56]  D. Salmond,et al.  A study of a nonlinear filtering problem for tracking an extended target , 2004 .

[57]  R.P.S. Mahler,et al.  "Statistics 101" for multisensor, multitarget data fusion , 2004, IEEE Aerospace and Electronic Systems Magazine.

[58]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[59]  Ba-Ngu Vo,et al.  CPHD Filtering With Unknown Clutter Rate and Detection Profile , 2011, IEEE Transactions on Signal Processing.

[60]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[61]  P. Cavanagh,et al.  Cortical fMRI activation produced by attentive tracking of moving targets. , 1998, Journal of neurophysiology.

[62]  Volkan Cevher,et al.  Decentralized State Initialization with Delay Compensation for Multi-modal Sensor Networks , 2007, J. VLSI Signal Process..

[63]  Wolfgang Koch,et al.  Cluster tracking under kinematical constraints using random matrices , 2008 .

[64]  Simon J. Godsill,et al.  Detection and Tracking of Coordinated Groups , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[65]  Feng Lian,et al.  Estimating Unknown Clutter Intensity for PHD Filter , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[66]  Frank Dellaert,et al.  Efficient particle filter-based tracking of multiple interacting targets using an MRF-based motion model , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[67]  D. Salmond,et al.  Spatial distribution model for tracking extended objects , 2005 .

[68]  D. Helbing Traffic and related self-driven many-particle systems , 2000, cond-mat/0012229.

[69]  Simon J. Godsill,et al.  Monte Carlo filtering and smoothing with application to time-varying spectral estimation , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[70]  Simon J. Godsill,et al.  Compressed Sensing & Sparse Filtering , 2013 .

[71]  Simon J. Godsill,et al.  The Gaussian mixture MCMC particle algorithm for dynamic cluster tracking , 2009, 2009 12th International Conference on Information Fusion.

[72]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[73]  Uwe D. Hanebeck,et al.  Shape tracking of extended objects and group targets with star-convex RHMs , 2011, 14th International Conference on Information Fusion.

[74]  Fahed Abdallah,et al.  An Introduction to Box Particle Filtering [Lecture Notes] , 2013, IEEE Signal Processing Magazine.

[75]  Erik Blaser,et al.  Tracking an object through feature space , 2000, Nature.

[76]  Christian Lundquist,et al.  An Extended Target CPHD Filter and a Gamma Gaussian Inverse Wishart Implementation , 2013, IEEE Journal of Selected Topics in Signal Processing.

[77]  Simon J. Godsill,et al.  Structure inference for networks with general non-parametric inter-object relationships , 2012, 2012 15th International Conference on Information Fusion.

[78]  Ba-Ngu Vo,et al.  The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations , 2009, IEEE Transactions on Signal Processing.

[79]  R. Hughes The flow of human crowds , 2003 .

[80]  Samuel J. Davey,et al.  Histogram-PMHT Unfettered , 2013, IEEE Journal of Selected Topics in Signal Processing.

[81]  Oliver E. Drummond,et al.  A bibliography of cluster (group) tracking , 2004, SPIE Defense + Commercial Sensing.

[82]  Cedric Nishan Canagarajah,et al.  Sequential Monte Carlo tracking by fusing multiple cues in video sequences , 2007, Image Vis. Comput..

[83]  Simon J. Godsill,et al.  MCMC-based tracking and identification of leaders in groups , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[84]  Neil J. Gordon,et al.  Group and extended object tracking , 1999, Optics & Photonics.

[85]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[86]  Roy L. Streit,et al.  A Sequential Monte Carlo Method for Multi-target Tracking with the Intensity Filter , 2013 .

[87]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[88]  Christian P. Robert,et al.  Monte Carlo Statistical Methods (Springer Texts in Statistics) , 2005 .

[89]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[90]  Fahed Abdallah,et al.  Box particle filtering for nonlinear state estimation using interval analysis , 2008, Autom..

[91]  Simon J. Godsill,et al.  Group Object Structure and State Estimation With Evolving Networks and Monte Carlo Methods , 2011, IEEE Transactions on Signal Processing.

[92]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[93]  P. Djurić,et al.  Particle filtering , 2003, IEEE Signal Process. Mag..

[94]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[95]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[96]  Samuel J. Davey,et al.  Histogram PMHT with target extent estimates based on random matrices , 2011, 14th International Conference on Information Fusion.

[97]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  Karl Granström,et al.  New prediction for extended targets with random matrices , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[99]  Thomas B. Schön,et al.  Parallel Implementation of Particle MCMC Methods on a GPU , 2012 .

[100]  Ba-Ngu Vo,et al.  Bayesian Filtering With Random Finite Set Observations , 2008, IEEE Transactions on Signal Processing.

[101]  D. Clark,et al.  Group Target Tracking with the Gaussian Mixture Probability Hypothesis Density Filter , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[102]  Branko Ristic,et al.  Bernoulli Particle/Box-Particle Filters for Detection and Tracking in the Presence of Triple Measurement Uncertainty , 2012, IEEE Transactions on Signal Processing.

[103]  Lorenzo Pareschi,et al.  Mathematical Modeling of Collective Behavior in Socio-Economic and Life Sciences , 2010 .

[104]  Petar M. Djuric,et al.  Resampling algorithms and architectures for distributed particle filters , 2005, IEEE Transactions on Signal Processing.

[105]  Allan Tucker,et al.  Advances in Intelligent Data Analysis XII , 2013, Lecture Notes in Computer Science.

[106]  Neil J. Gordon,et al.  Editors: Sequential Monte Carlo Methods in Practice , 2001 .

[107]  I. Gomez-Conde,et al.  Tracking T and B cells from two-photon microscopy imaging using constrained SMC clusters , 2011, J. Integr. Bioinform..

[108]  Thierry Chateau,et al.  MCMC Particle Filter for Real-Time Visual Tracking of Vehicles , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[109]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[110]  Ronald Mahler,et al.  Bulk multitarget tracking using a first-order multitarget moment filter , 2002, SPIE Defense + Commercial Sensing.

[111]  Christian Lundquist,et al.  Extended Target Tracking using a Gaussian-Mixture PHD Filter , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[112]  Ernest J. Ohlmeyer,et al.  Integrated Guidance and Control for Missiles , 2016 .

[113]  Mark Coates,et al.  Distributed particle filters for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[114]  Garrick Ing,et al.  Distributed Particle Filters for Object Tracking in Sensor Networks , 2005 .

[115]  Uwe D. Hanebeck,et al.  Extended object tracking based on combined set-theoretic and stochastic fusion , 2009, 2009 12th International Conference on Information Fusion.

[116]  S. Godsill,et al.  Monte Carlo filtering for multi target tracking and data association , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[117]  Parameswaran Ramanathan,et al.  Distributed particle filter with GMM approximation for multiple targets localization and tracking in wireless sensor network , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[118]  Christian Borgelt,et al.  Advances in Intelligent Data Analysis V , 2003, Lecture Notes in Computer Science.

[119]  Simon Maskell,et al.  Distributed Tracking of Stealthy Targets using Particle Filters , 2006 .

[120]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[121]  Thia Kirubarajan,et al.  An Optimization-Based Parallel Particle Filter for Multitarget Tracking , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[122]  Michael Unser,et al.  A new hybrid Bayesian-variational particle filter with application to mitotic cell tracking , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[123]  Karl Granström,et al.  A phd Filter for Tracking Multiple Extended Targets Using Random Matrices , 2012, IEEE Transactions on Signal Processing.

[124]  Ronald P. S. Mahler,et al.  PHD filters for nonstandard targets, I: Extended targets , 2009, 2009 12th International Conference on Information Fusion.

[125]  Simon J. Godsill,et al.  Inferring Leadership from Group Dynamics Using Markov Chain Monte Carlo Methods , 2013, Modeling, Simulation and Visual Analysis of Crowds.

[126]  Joris De Schutter,et al.  Shape-Based Online Multitarget Tracking and Detection for Targets Causing Multiple Measurements: Variational Bayesian Clustering and Lossless Data Association , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[127]  Cedric Nishan Canagarajah,et al.  Contour tracking of contaminant clouds with sequential Monte Carlo methods , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[128]  Ba-Ngu Vo,et al.  A Tutorial on Bernoulli Filters: Theory, Implementation and Applications , 2013, IEEE Transactions on Signal Processing.

[129]  Roy L. Streit Multisensor multitarget intensity filter , 2008, 2008 11th International Conference on Information Fusion.

[130]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[131]  Daniel E. Clark,et al.  The single-group PHD filter: An analytic solution , 2011, 14th International Conference on Information Fusion.

[132]  Joaquín Míguez,et al.  Analysis of parallelizable resampling algorithms for particle filtering , 2007, Signal Process..

[133]  Uwe D. Hanebeck,et al.  Tracking an Extended Object Modeled as an Axis-Aligned Rectangle , 2009, GI Jahrestagung.

[134]  Dinesh Manocha,et al.  Modeling, Simulation and Visual Analysis of Crowds: A Multidisciplinary Perspective , 2013, Modeling, Simulation and Visual Analysis of Crowds.

[135]  X. R. Li,et al.  Tracking of extended object or target group using random matrix — Part II: Irregular object , 2012, 2012 15th International Conference on Information Fusion.

[136]  Fredrik Gustafsson,et al.  Track-before-detect algorithm for tracking extended targets , 2006 .

[137]  Thomas B. Schön,et al.  Particle Filter in Practice , 2011 .

[138]  Sergio A. Velastin,et al.  Crowd analysis: a survey , 2008, Machine Vision and Applications.

[139]  Dietrich Fränken,et al.  Advances on tracking of extended objects and group targets using random matrices , 2009, 2009 12th International Conference on Information Fusion.

[140]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[141]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[142]  Luc Van Gool,et al.  Wrong turn - No dead end: A stochastic pedestrian motion model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[143]  Mónica F. Bugallo,et al.  Multiple Particle Filtering , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[144]  P. Pérez,et al.  Tracking multiple objects with particle filtering , 2002 .

[145]  David J. Hand,et al.  Advances in intelligent data analysis , 2000 .

[146]  Ronald P. S. Mahler,et al.  “Statistics 102” for Multisource-Multitarget Detection and Tracking , 2013, IEEE Journal of Selected Topics in Signal Processing.

[147]  Arnaud Doucet,et al.  On the Utility of Graphics Cards to Perform Massively Parallel Simulation of Advanced Monte Carlo Methods , 2009, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[148]  Benedetto Piccoli,et al.  Modeling self-organization in pedestrians and animal groups from macroscopic and microscopic viewpoints , 2009, 0906.4702.

[149]  Ronald Mahler,et al.  CPHD and PHD filters for unknown backgrounds, part III: tractable multitarget filtering in dynamic clutter , 2010, Defense + Commercial Sensing.

[150]  Daniel E. Clark,et al.  Extended object filtering using spatial independent cluster processes , 2010, 2010 13th International Conference on Information Fusion.

[151]  Yonina C. Eldar,et al.  Introduction to Compressed Sensing , 2022 .

[152]  Hans Driessen,et al.  Multitarget tracking with IP reversible jump MCMC-PF , 2013, Proceedings of the 16th International Conference on Information Fusion.

[153]  Yvo Boers,et al.  A Track Before Detect Approach for Extended Objects , 2006, 2006 9th International Conference on Information Fusion.

[154]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[155]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[156]  W. Koch,et al.  A Bayesian approach to extended object tracking and tracking of loosely structured target groups , 2005, 2005 7th International Conference on Information Fusion.

[157]  Douglas B. Kell,et al.  Automatic tracking of biological cells and compartments using particle filters and active contours , 2006 .

[158]  Hans Driessen,et al.  Multitarget Tracking With Multiscan Knowledge Exploitation Using Sequential MCMC Sampling , 2013, IEEE Journal of Selected Topics in Signal Processing.