Relations to improve multi-target tracking in an activity recognition system

The explicit recognition of the relationships between interacting objects can improve the understanding of their dynamics. In this work, we investigate the use of relational dynamic Bayesian networks to represent the interactions between moving objects in a surveillance system. We use a transition model that incorporates first-order logic relations and a two-phases particle filter algorithm in order to directly track relations between targets. We present some results about activity recognition in monitoring coastal borders. (6 pages)

[1]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[2]  Larry S. Davis,et al.  Event Modeling and Recognition Using Markov Logic Networks , 2008, ECCV.

[3]  Michael Isard,et al.  A mixed-state condensation tracker with automatic model-switching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, CVPR.

[6]  Stuart J. Russell,et al.  General-Purpose MCMC Inference over Relational Structures , 2006, UAI.

[7]  Ben Taskar,et al.  Learning Probabilistic Models of Link Structure , 2003, J. Mach. Learn. Res..

[8]  Daphne Koller,et al.  Learning Object Shape: From Drawings to Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[10]  Martial Hebert,et al.  Event Detection in Crowded Videos , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Dima Damen,et al.  Associating People Dropping off and Picking up Objects , 2007, BMVC.

[12]  Pedro M. Domingos,et al.  A General Method for Reducing the Complexity of Relational Inference and its Application to MCMC , 2008, AAAI.

[13]  Roni Khardon,et al.  First Order Decision Diagrams for Relational MDPs , 2007, IJCAI.