Continuous Learning of a Multilayered Network Topology in a Video Camera Network

A multilayered camera network architecture with nodes as entry/exit points, cameras, and clusters of cameras at different layers is proposed. Unlike existing methods that used discrete events or appearance information to infer the network topology at a single level, this paper integrates face recognition that provides robustness to appearance changes and better models the time-varying traffic patterns in the network. The statistical dependence between the nodes, indicating the connectivity and traffic patterns of the camera network, is represented by a weighted directed graph and transition times that may have multimodal distributions. The traffic patterns and the network topology may be changing in the dynamic environment. We propose a Monte Carlo Expectation-Maximization algorithm-based continuous learning mechanism to capture the latent dynamically changing characteristics of the network topology. In the experiments, a nine-camera network with twenty-five nodes (at the lowest level) is analyzed both in simulation and in real-life experiments and compared with previous approaches.

[1]  Hugh F. Durrant-Whyte,et al.  Mobile robot localization by tracking geometric beacons , 1991, IEEE Trans. Robotics Autom..

[2]  Leon Hempel,et al.  On the Threshold to Urban Panopticon? Analysing the Employment of CCTV in European Cities and Assessing its Social and Political Impacts , 2004 .

[3]  Bruce S. Davie,et al.  Computer Networks: A Systems Approach , 1996 .

[4]  Xiaoli Zhou,et al.  Integrating Face and Gait for Human Recognition at a Distance in Video , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Rong Wang,et al.  Learning models for predicting recognition performance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, CVPR.

[8]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Amit K. Roy-Chowdhury,et al.  Pose and Illumination Invariant Face Recognition in Video , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Neil J. Gordon,et al.  Editors: Sequential Monte Carlo Methods in Practice , 2001 .

[11]  Amit K. Roy-Chowdhury,et al.  Super-Resolved Facial Texture Under Changing Pose and Illumination , 2007, 2007 IEEE International Conference on Image Processing.

[12]  Robert B. Fisher Self-Organization of Randomly Placed Sensors , 2002, ECCV.

[13]  Bir Bhanu,et al.  Anomalous activity classification in the distributed camera network , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Frank Dellaert,et al.  Addressing the Correspondence Problem: A Markov Chain Monte Carlo Approach , 2000 .

[16]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[17]  Bruce S. Davie,et al.  Computer Networks: A Systems Approach, 3rd Edition , 2003 .

[18]  David J. Fleet,et al.  Learning Sensor Network Topology through Monte Carlo Expectation Maximization , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[20]  W. Eric L. Grimson,et al.  Recovering Non-overlapping Network Topology Using Far-field Vehicle Tracking Data , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[21]  G. C. Wei,et al.  A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms , 1990 .

[22]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Bir Bhanu,et al.  VideoWeb: Design of a wireless camera network for real-time monitoring of activities , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[24]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[25]  Amit K. Roy-Chowdhury,et al.  Determining Topology in a Distributed Camera Network , 2007, 2007 IEEE International Conference on Image Processing.

[26]  Bir Bhanu,et al.  Super-resolution and facial expression for face recognition in video , 2007 .

[27]  Rahul Sukthankar,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[28]  John W. Fisher,et al.  Nonparametric belief propagation for self-localization of sensor networks , 2005, IEEE Journal on Selected Areas in Communications.