Learning Higher-order Transition Models in Medium-scale Camera Networks

We present a Bayesian framework for learning higher- order transition models in video surveillance networks. Such higher-order models describe object movement between cameras in the network and have a greater predictive power for multi-camera tracking than camera adjacency alone. These models also provide inherent resilience to camera failure, filling in gaps left by single or even multiple non-adjacent camera failures. Our approach to estimating higher-order transition models relies on the accurate assignment of camera observations to the underlying trajectories of objects moving through the network. We addresses this data association problem by gathering the observations and evaluating alternative partitions of the observation set into individual object trajectories. Searching the complete partition space is intractable, so an incremental approach is taken, iteratively adding observations and pruning unlikely partitions. Partition likelihood is determined by the evaluation of a probabilistic graphical model. When the algorithm has considered all observations, the most likely (MAP) partition is taken as the true object trajectories. From these recovered trajectories, the higher-order statistics we seek can be derived and employed for tracking. The partitioning algorithm we present is parallel in nature and can be readily extended to distributed computation in medium-scale smart camera networks.

[1]  E. Grossmann,et al.  The Terrascope Dataset: Scripted Multi-Camera Indoor Video Surveillance with Ground-truth , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[2]  Alan S. Willsky,et al.  Distributed data association for multi-target tracking in sensor networks , 2005 .

[3]  Yaacov Ritov,et al.  Tracking Many Objects with Many Sensors , 1999, IJCAI.

[4]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[5]  W. P. Zajdel,et al.  Bayesian visual surveillance : from object detection to distributed cameras , 2006 .

[6]  Feng Zhao,et al.  Distributed multiple target tracking and data association in ad hoc sensor networks , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[7]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Mark S. Fox,et al.  Constraint-Directed Search: A Case Study of Job-Shop Scheduling , 1987 .

[9]  Stuart J. Russell,et al.  Object Identification in a Bayesian Context , 1997, IJCAI.

[10]  Ben J. A. Kröse,et al.  A sequential Bayesian algorithm for surveillance with nonoverlapping cameras , 2005, Int. J. Pattern Recognit. Artif. Intell..

[11]  Rahul Sukthankar,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[12]  Ramin Zabih,et al.  Bayesian multi-camera surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[13]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[14]  Chris Stauffer,et al.  Automated multi-camera planar tracking correspondence modeling , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Songhwai Oh,et al.  Markov chain Monte Carlo data association for general multiple-target tracking problems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[16]  Yang Yu,et al.  HUMAN APPEARANCE MODELING IN VISUAL SURVEILLANCE , 2007 .

[17]  Ben J. A. Kröse,et al.  Dynamic Bayesian Networks for Visual Surveillance with Distributed Cameras , 2006, EuroSSC.

[18]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.