Joint tracking and classification of nonlinear trajectories of multiple objects using the transferable belief model and multi-sensor fusion framework

In this paper, we present our findings of investigating non-linear multi-target tracking techniques when jointly used with object classification. The transferable belief model (TBM) is utilized in the multi-target evaluation, data association, and target classification stages. A particle filter is used to track each of the targets and uses a motion model that is relevant to the classification given to that target. The targets are classified based upon their motion throughout the scene and their land based position. We show how this system can deal with prior knowledge and lack of knowledge. Situations, with data of this type, regularly occur in real world scenarios and we think it is very important that any system must be able to cope well to such situations. Bayesian and regular DST methods have shortcomings when dealing with such scenarios. We show that the TBM approach can be generally more computational tractable and more robust.

[1]  P. L. Bogler,et al.  Shafer-dempster reasoning with applications to multisensor target identification systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Thiagalingam Kirubarajan,et al.  Efficient particle filters for joint tracking and classification , 2002, SPIE Defense + Commercial Sensing.

[3]  Johan Schubert,et al.  Cluster-based Specification Techniques in Dempster-Shafer Theory , 1995, ECSQARU.

[4]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[5]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[6]  Philippe Smets Application of the transferable belief model to diagnostic problems , 1998, Int. J. Intell. Syst..

[7]  P. Smets Application of the transferable belief model to diagnostic problems , 1998 .

[8]  Samuel S. Blackman,et al.  Multiple-Target Tracking with Radar Applications , 1986 .

[9]  Subhash Challa,et al.  Joint target tracking and classification using radar and ESM sensors , 2001 .

[10]  Robert B. McGhee,et al.  An extended Kalman filter for quaternion-based orientation estimation using MARG sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[11]  Philippe Smets,et al.  The Transferable Belief Model for Quantified Belief Representation , 1998 .

[12]  Jr. J.J. LaViola,et al.  A comparison of unscented and extended Kalman filtering for estimating quaternion motion , 2003, Proceedings of the 2003 American Control Conference, 2003..

[13]  Nic Wilson Algorithms for Dempster-Shafer Theory , 2000 .

[14]  Philippe Smets,et al.  Data association in multi‐target detection using the transferable belief model , 2001, Int. J. Intell. Syst..

[15]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[16]  Hugh F. Durrant-Whyte,et al.  A decentralized Bayesian algorithm for identification of tracked targets , 1993, IEEE Trans. Syst. Man Cybern..

[17]  Jorge Dias,et al.  Face tracking based on haar-like features and eigenfaces , 2004 .

[18]  Jürg Kohlas,et al.  Handbook of Defeasible Reasoning and Uncertainty Management Systems , 2000 .

[19]  Donka Angelova,et al.  Sequential Monte Carlo algorithms for joint target tracking and classification using kinematic radar information , 2004 .

[20]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[21]  Frank Dellaert,et al.  Efficient particle filter-based tracking of multiple interacting targets using an MRF-based motion model , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Michael Isard,et al.  BraMBLe: a Bayesian multiple-blob tracker , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  David Marshall,et al.  Data fusion of FLIR and LADAR in autonomous weapons systems , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[24]  Branko Ristic,et al.  Kalman filter and joint tracking and classification based on belief functions in the TBM framework , 2007, Inf. Fusion.

[25]  Branko Ristic,et al.  Kalman Filter and Joint Tracking and Classification in the TBM framework , 2004 .