Effective distributed service architecture for ubiquitous video surveillance

Video surveillance systems are playing an important role to protect lives and assets of individuals, enterprises and governments. Due to the prevalence of wired and wireless access to Internet, it would be a trend to integrate present isolated video surveillance systems by applying distributed computing environment and to further gestate diversified multimedia intelligent surveillance (MIS) applications in ubiquity. In this paper, we propose a distributed and secure architecture for ubiquitous video surveillance (UVS) services over Internet and error-prone wireless networks with scalability, ubiquity and privacy. As cloud computing, users consume UVS related resources as a service and do not need to own the physical infrastructure, platform, or software. To protect the service privacy, preserve the service scalability and provide reliable UVS video streaming for end users, we apply the AES security mechanism, multicast overlay network and forward error correction (FEC), respectively. Different value-added services can be created and added to this architecture without introducing much traffic load and degrading service quality. Besides, we construct an experimental test-bed for UVS system with three kinds of services to detect fire and fall-incident features and record the captured video at the same time. Experimental results showed that the proposed distributed service architecture is effective and numbers of services on different multicast islands were successfully connected without influencing the playback quality. The average sending rate and the receiving rates of these services are quite similar, and the surveillance video is smoothly played.

[1]  P. L. Venetianer,et al.  Stationary target detection using the objectvideo surveillance system , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[2]  Jan-Ming Ho,et al.  An effective communication model for collaborative commerce of Web-based surveillance services , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[3]  Max Lu,et al.  Robust and efficient foreground analysis for real-time video surveillance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Vinay Kumar,et al.  Mbone: Interactive Multimedia on the Internet , 1995 .

[5]  Carlo S. Regazzoni,et al.  A distributed surveillance system for detection of abandoned objects in unmanned railway environments , 2000, IEEE Trans. Veh. Technol..

[6]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[7]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..

[8]  Kevin Smith,et al.  Detecting Abandoned Luggage Items in a Public Space , 2006 .

[9]  Ahmet M. Kondoz,et al.  MPEG-4 video transcoder for mobile multimedia traffic planning , 2001 .

[10]  Joseph P. Macker,et al.  Reliable multicast transport and integrated erasure-based forward error correction , 1997, MILCOM 97 MILCOM 97 Proceedings.

[11]  Lisa M. Brown,et al.  The IBM Smart Surveillance System , 2004 .

[12]  L. Hanzo,et al.  Interactive cellular and cordless video telephony: State-of-the-art system design principles and expected performance , 2000, Proceedings of the IEEE.

[13]  Carlo S. Regazzoni,et al.  Localisation and tracking of multiple unknown objects in real environments , 1995 .

[14]  Wanjiun Liao,et al.  A Distributed Key-Changing Mechanism for Secure Voice Over IP (VoIP) Service , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[15]  Gian Luca Foresti,et al.  Automatic Video Surveillance of Harbour Structures , 2009 .

[16]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[17]  Haw-Yun Shin,et al.  Load-sharing overlay network design for ubiquitous video surveillance services , 2009, 2009 International Conference on Ultra Modern Telecommunications & Workshops.

[18]  Sharath Pankanti,et al.  Detection and tracking in the IBM PeopleVision system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[19]  Narendra Ahuja,et al.  Vision based fire detection , 2004, ICPR 2004.

[20]  Michael D. Beynon,et al.  Detecting abandoned packages in a multi-camera video surveillance system , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[21]  Mubarak Shah,et al.  Flame recognition in video , 2002, Pattern Recognit. Lett..

[22]  Michael J. DeWeert,et al.  Harbour Protection Through Data Fusion Technologies , 2009 .

[23]  Gian Luca Foresti,et al.  Distributed architectures and logical-task decomposition in multimedia surveillance systems , 2001, Proc. IEEE.

[24]  L. Hanzo,et al.  Adaptive multicarrier modulation: a convenient framework for time-frequency processing in wireless communications , 2000, Proceedings of the IEEE.

[25]  Hamid K. Aghajan,et al.  Architecture for Cluster-Based Automated Surveillance Network for Detecting and Tracking Multiple Persons , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[26]  New Riders MBONE: Interactive Multimedia on the Internet , 1995 .

[27]  Mark Watson,et al.  Forward Error Correction (FEC) Building Block , 2007, RFC.

[28]  Eric Rescorla,et al.  Diffie-Hellman Key Agreement Method , 1999, RFC.

[29]  Kevin C. Almeroth,et al.  IP Multicast Applications: Challenges and Solutions , 2001, RFC.

[30]  Carlo S. Regazzoni,et al.  Real-time video-shot detection for scene surveillance applications , 2000, IEEE Trans. Image Process..

[31]  Monique Thonnat,et al.  The PASSWORDS Project [intelligent video image analysis system] , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[32]  R.-I. Chang,et al.  Ubiquitous video surveillance service with secure forwarding agents , 2008, 2008 14th Asia-Pacific Conference on Communications.

[33]  Stephen E. Deering,et al.  Host extensions for IP multicasting , 1986, RFC.

[34]  Gian Luca Foresti,et al.  Automatic detection and indexing of video-event shots for surveillance applications , 2002, IEEE Trans. Multim..

[35]  Mostafa H. Ammar,et al.  A comparison of heterogeneous video multicast schemes: Layered encoding or stream replication , 2005, IEEE Transactions on Multimedia.

[36]  Anthony Rowe,et al.  Real-Time Video Surveillance over IEEE 802.11 Mesh Networks , 2009, 2009 15th IEEE Real-Time and Embedded Technology and Applications Symposium.

[37]  Ralf Steinmetz,et al.  Layer-encoded video in scalable adaptive streaming , 2005, IEEE Transactions on Multimedia.

[38]  Carlo S. Regazzoni,et al.  Distributed data fusion for real-time crowding estimation , 1996, Signal Process..

[39]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[40]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework , 2008, Machine Vision and Applications.

[41]  Sophia Antipolis,et al.  THE PASSWORDS PROJECT , 2004 .

[42]  Tieniu Tan,et al.  Recognizing objects on the ground-plane , 1994, Image Vis. Comput..