A network of sensor-based framework for automated visual surveillance

This paper presents an architecture for sensor-based, distributed, automated scene surveillance. The goal of the work is to employ wireless visual sensors, scattered in an area, for detection and tracking of objects of interest and their movements through application of agents. The architecture consists of several units known as Object Processing Units (OPUs) that are wirelessly connected in a cluster fashion. Cluster heads communicate with the Scene Processing Units which are responsible for analyzing all the information sent by the former. Object detection and tracking is performed by cooperative agents, named as Region and Object Agents. The area under surveillance is divided into several sub-areas. One camera is assigned to each sub-area. A Region Agent (RA) is responsible for monitoring a given sub-area. First, a background subtraction is performed on the scene taken by the camera. Then, a computed foreground mask is passed to the RA, which is responsible for creating Object Agents dedicated to tracking detected objects. Object detection and tracking is done automatically and is performed on the OPU. The tracking information and foreground mask are sent to a Scene Processing Unit that analyzes this information and determines if a threat pattern is present at the scene and performs appropriate action.

[1]  Hyacinth S. Nwana,et al.  2 Multi-Agent Systems : Promises and Reality , 1999 .

[2]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[3]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Richard Alan Peters,et al.  A comparison of neural and statistical techniques in object recognition , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[5]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[6]  Bernd Heisele,et al.  Visual Object Recognition with Supervised Learning , 2003, IEEE Intell. Syst..

[7]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[8]  Hyacinth S. Nwana,et al.  The ZEUS Agent Building Tool-kit , 1998 .

[9]  Guillermo Ricardo Simari,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 2000 .

[10]  Pascal Vasseur,et al.  Introduction to multi-sensor data fusion , 2004 .

[11]  Timothy W. Finin,et al.  An Overview of KQML: A Knowledge Query and Manipulation Language , 1991 .

[12]  Zoran Dimitrijevic,et al.  SFINX: a multisensor fusion and mining system , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[13]  Kung Yao,et al.  Source localization and beamforming , 2002, IEEE Signal Process. Mag..

[14]  Anantha Chandrakasan,et al.  Energy-scalable algorithms and protocols for wireless microsensor networks , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[15]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[16]  Toshio Kamei.  Face retrieval by an adaptive Mahalanobis distance using a confidence factor , 2002, Proceedings. International Conference on Image Processing.

[17]  Nathan Ickes,et al.  Design considerations for next generation wireless power-aware microsensor nodes , 2004, 17th International Conference on VLSI Design. Proceedings..

[18]  M. Gribaudo,et al.  2002 , 2001, Cell and Tissue Research.

[19]  Michael J. Brooks,et al.  Issues in Automated Visual Surveillance , 2003, DICTA.

[20]  Paolo Remagnino,et al.  Distributed intelligence for multi-camera visual surveillance , 2004, Pattern Recognit..

[21]  Elhadi M. Shakshuki,et al.  Using agent-based approach to tracking moving objects , 2003, 17th International Conference on Advanced Information Networking and Applications, 2003. AINA 2003..

[22]  A. Chandrakasan,et al.  Energy-efficient DSPs for wireless sensor networks , 2002, IEEE Signal Process. Mag..

[23]  Anantha Chandrakasan,et al.  Vibration-to-electric energy conversion , 1999, Proceedings. 1999 International Symposium on Low Power Electronics and Design (Cat. No.99TH8477).

[24]  Munindar P. Singh,et al.  Readings in agents , 1997 .

[25]  Niki Pissinou,et al.  An Agent-Based Mobile System , 1997, ER.

[26]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[27]  Tim Menzies,et al.  Knowledge maintenance: the state of the art , 1999, The Knowledge Engineering Review.

[28]  George W. Fitzmaurice,et al.  The envoy framework: an open architecture for agents , 1992, TOIS.

[29]  Michael Wooldridge,et al.  Applications of intelligent agents , 1998 .

[30]  Samir Aknine,et al.  An Extended Multi-Agent Negotiation Protocol , 2004, Autonomous Agents and Multi-Agent Systems.

[31]  Norimichi Ukita,et al.  Real-time multitarget tracking by a cooperative distributed vision system , 2002, Proc. IEEE.

[32]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Bernhard Nebel,et al.  Cooperative sensing in dynamic environments , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[34]  P. Mahadevan,et al.  An overview , 2007, Journal of Biosciences.

[35]  Milind Tambe,et al.  Automated Assistants for Analyzing Team Behaviors , 2004, Autonomous Agents and Multi-Agent Systems.

[36]  Anantha Chandrakasan,et al.  Dynamic Power Management in Wireless Sensor Networks , 2001, IEEE Des. Test Comput..

[37]  T. Ebrahimi,et al.  Change detection and background extraction by linear algebra , 2001, Proc. IEEE.

[38]  S. Sitharama Iyengar,et al.  Distributed Sensor Networks , 2004 .

[39]  H. Buxton,et al.  Advanced visual surveillance using Bayesian networks , 1997 .

[40]  Marcos Augusto M. Vieira,et al.  Survey on wireless sensor network devices , 2003, EFTA 2003. 2003 IEEE Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.03TH8696).

[42]  Mohamed S. Kamel,et al.  An agent-based approach to multisensor coordination , 2003, IEEE Trans. Syst. Man Cybern. Part A.