Survey on Contemporary Remote Surveillance Systems for Public Safety

Surveillance systems provide the capability of collecting authentic and purposeful information and forming appropriate decisions to enhance safety. This paper reviews concisely the historical development and current state of the three different generations of contemporary surveillance systems. Recently, in addition to the employment of the incessantly enlarging variety of sensors, the inclination has been to utilize more intelligence and situation awareness capabilities to assist the human surveillance personnel. The most recent generation is decomposed into multisensor environments, video and audio surveillance, wireless sensor networks, distributed intelligence and awareness, architecture and middleware, and the utilization of mobile robots. The prominent difficulties of the contemporary surveillance systems are highlighted. These challenging dilemmas are composed of the attainment of real-time distributed architecture, awareness and intelligence, existing difficulties in video surveillance, the utilization of wireless networks, the energy efficiency of remote sensors, the location difficulties of surveillance personnel, and scalability difficulties. The paper is concluded with concise summary and the future of surveillance systems for public safety.

[1]  Gian Luca Foresti,et al.  Sensor Bandwidth Assignment through Video Annotation , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[2]  A. Hero,et al.  Multitarget tracking using the joint multitarget probability density , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[3]  J.A. O'Sullivan,et al.  Advances in Security Technologies: Imaging, Anomaly Detection, and Target and Biometric Recognition , 2007, 2007 IEEE/MTT-S International Microwave Symposium.

[4]  Ioannis Pavlidis,et al.  Urban surveillance systems: from the laboratory to the commercial world , 2001, Proc. IEEE.

[5]  Guoliang Xing,et al.  Impact of sensing coverage on greedy geographic routing algorithms , 2006, IEEE Transactions on Parallel and Distributed Systems.

[6]  Sheng-Wen Shih,et al.  Spatiotemporal Motion Analysis for the Detection and Classification of Moving Targets , 2008, IEEE Transactions on Multimedia.

[7]  Albert S. White.  Application of Signal Corps Radar to Combat Surveillance , 1960, IRE Transactions on Military Electronics.

[8]  Gang Wei,et al.  Multiple-Sensor Indoor Surveillance System , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[9]  Daniel Thalmann,et al.  Advanced virtual reality technologies for surveillance and security applications , 2006, VRCIA '06.

[10]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  S. Plano,et al.  Proactive decision fusion for site security , 2005, 2005 7th International Conference on Information Fusion.

[12]  Jean-Marc Odobez,et al.  Toward Generic Intelligent Knowledge Extraction from Video and Audio: The EU-Funded Caretaker Project , 2006 .

[13]  Pradeep K. Atrey,et al.  Confidence Evolution in Multimedia Systems , 2008, IEEE Transactions on Multimedia.

[14]  Gian Luca Foresti,et al.  Active Video-Based Surveillance System , 2005 .

[15]  William M. Thames.  From Eye to Electron---Management Problems of the Combat Surveillance Research and Development Field , 1960, IRE Transactions on Military Electronics.

[16]  Yu-Chee Tseng,et al.  iMouse: An Integrated Mobile Surveillance and Wireless Sensor System , 2007, Computer.

[17]  Xiaochun Cao,et al.  Map-based Active Leader-Follower Surveillance System , 2008 .

[18]  Yu-Chee Tseng,et al.  Event-driven messaging services over integrated cellular and wireless sensor networks: prototyping experiences of a visitor system , 2005, IEEE Journal on Selected Areas in Communications.

[19]  M.D. Naish,et al.  Active-vision-based multisensor surveillance - an implementation , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Wolfgang Straßer,et al.  Smart Camera Based Monitoring System and Its Application to Assisted Living , 2008, Proceedings of the IEEE.

[21]  Xiaochun Cao,et al.  Automated visual analysis in large scale sensor networks , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[22]  Zoltan Safar,et al.  Multimodal Wireless Networks: Communication and Surveillance on the Same Infrastructure , 2007, IEEE Transactions on Information Forensics and Security.

[23]  Tarak Gandhi,et al.  Distributed interactive video arrays for event capture and enhanced situational awareness , 2005, IEEE Intelligent Systems.

[24]  Xiaochun Cao,et al.  Automatic Geo-registration and Inter-Sensor Calibration in Large Sensor Networks , 2009 .

[25]  Herbert A. Nye.  The Problem of Combat Surveillance , 1960, IRE Transactions on Military Electronics.

[26]  Meng Wang,et al.  iBotGuard: an Internet-based Intelligent Robot security system using Invariant Face Recognition against intruder , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[27]  Annalisa Milella,et al.  Multi-Sensor Surveillance ofIndoor Environments by anAutonomous Mobile Robot , 2008 .

[28]  Zoran Dimitrijevic,et al.  SFINX: a multisensor fusion and mining system , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[29]  Tieniu Tan,et al.  Principal axis-based correspondence between multiple cameras for people tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Rama Chellappa,et al.  A Constrained Probabilistic Petri Net Framework for Human Activity Detection in Video* , 2008, IEEE Transactions on Multimedia.

[31]  Miodrag Potkonjak,et al.  Worst and best-case coverage in sensor networks , 2005, IEEE Transactions on Mobile Computing.

[32]  F. Ziliani,et al.  Scalable video requirements for surveillance applications , 2004 .

[33]  Jin-Shyan Lee,et al.  A Petri Net Design of Command Filters for Semiautonomous Mobile Sensor Networks , 2008, IEEE Transactions on Industrial Electronics.

[34]  Xiaochun Cao,et al.  Omni-Directional Surveillance for Unmanned Water Vehicles , 2008 .

[35]  H. W. Harvey,et al.  Testing of mobile surveillance robot at a nuclear power plant , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[36]  Gian Luca Foresti,et al.  Special issue on video communications, processing, and understanding for third generation surveillance systems , 2001 .

[37]  Li-Qun Xu.  Issues in video analytics and surveillance systems: Research / prototyping vs. applications / user requirements , 2007, AVSS.

[38]  Elaine J. Weyuker,et al.  Reliability Testing of Rule-Based Systems , 1996, IEEE Softw..

[39]  Carlo S. Regazzoni,et al.  A Bio-inspired Learning Approach for the Classification of Risk Zones in a Smart Space , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[41]  Sergio A. Velastin,et al.  Real-time architecture for a large distributed surveillance system , 2004 .

[42]  Ram Nevatia,et al.  Learning to associate: HybridBoosted multi-target tracker for crowded scene , 2009, CVPR.

[43]  Riad I. Hammoud,et al.  Robust Multi-Pedestrian Tracking in Thermal-Visible Surveillance Videos , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[44]  Brian C. Lovell,et al.  A high resolution smart camera with GigE Vision extension for surveillance applications , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[45]  Gert Cauwenberghs,et al.  A comparative study of sound localization algorithms for energy aware sensor network nodes , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[46]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[47]  Rita Cucchiara,et al.  Computer vision system for in-house video surveillance , 2005 .

[48]  Michael K. Reiter,et al.  Homeland Security , 2004, IEEE Internet Comput..

[49]  Chu Kiong Loo,et al.  An Effective Surveillance System Using Thermal Camera , 2009, 2009 International Conference on Signal Acquisition and Processing.

[50]  László Havasi,et al.  Detection of Gait Characteristics for Scene Registration in Video Surveillance System , 2007, IEEE Transactions on Image Processing.

[51]  Curtis E. Wolfe.  Information System Displays for Aerospace Surveillance Applications , 1964, IEEE Transactions on Aerospace.

[52]  Wei Tsang Ooi,et al.  Critical video quality for distributed automated video surveillance , 2005, MULTIMEDIA '05.

[53]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[54]  Suki Kim,et al.  A Portable Surveillance Camera Architecture using One-bit Motion Detection , 2007, IEEE Transactions on Consumer Electronics.

[55]  Mubarak Shah,et al.  Automated Visual Surveillance in Realistic Scenarios , 2007, IEEE MultiMedia.

[56]  Dorin Comaniciu,et al.  Design, analysis, and engineering of video monitoring systems: an approach and a case study , 2001, Proc. IEEE.

[57]  Bernhard Rinner,et al.  Online multi-criterion optimization for dynamic power-aware camera configuration in distributed embedded surveillance clusters , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[58]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[59]  Alan F. Smeaton,et al.  Towards event detection in an audio-based sensor network , 2005, VSSN@MM.

[60]  Xiaohua Jia,et al.  Maximizing Lifetime of Sensor Surveillance Systems , 2007, IEEE/ACM Transactions on Networking.

[61]  S. C. Hui,et al.  Web-based intelligent surveillance system for detection of criminal activities , 2001 .

[62]  Aljoscha Smolic,et al.  3-D reconstruction of a dynamic environment with a fully calibrated background for traffic scenes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[63]  Tonya L. Smith-Jackson,et al.  Effects of Video Placement and Spatial Context Presentation on Path Reconstruction Tasks with Contextualized Videos , 2008, IEEE Transactions on Visualization and Computer Graphics.

[64]  Antonio Fernández-Caballero,et al.  Holonic Multi-agent Systems to Integrate Independent Multi-sensor Platforms in Complex Surveillance , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[65]  Gert Cauwenberghs,et al.  Micropower gradient flow acoustic localizer , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[66]  W. Meira,et al.  Mobile Robotics , 2008, Encyclopedia of GIS.

[67]  G.L. Foresti,et al.  Active video-based surveillance system: the low-level image and video processing techniques needed for implementation , 2005, IEEE Signal Processing Magazine.

[68]  Y. Imai,et al.  Development and a brief evaluation of a web-based surveillance system for cellular phones and other mobile computing clients , 2008, 2008 Conference on Human System Interactions.

[69]  Miguel A. Patricio,et al.  Robust data fusion in a visual sensor multi-agent architecture , 2007, 2007 10th International Conference on Information Fusion.

[70]  Sergio A. Velastin,et al.  PRISMATICA: toward ambient intelligence in public transport environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[71]  J.A. Besada,et al.  Airport surface surveillance based on video images , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[72]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[73]  Michel Vacher,et al.  Information extraction from sound for medical telemonitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[74]  C. Micheloni,et al.  A network of co-operative cameras for visual surveillance , 2005 .

[75]  Douglas L. Jones,et al.  Energy-efficient detection in sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[76]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[77]  Hamid Aghajan,et al.  Smart home care network using sensor fusion and distributed vision-based reasoning , 2006, VSSN '06.

[78]  Pramod K. Varshney,et al.  Quality-Based Fusion of Multiple Video Sensors for Video Surveillance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[79]  David S. Munro,et al.  Middleware for video surveillance networks , 2006, MidSens '06.

[80]  S. Y. Harmon.  The ground surveillance robot (GSR): An autonomous vehicle designed to transit unknown terrain , 1987, IEEE J. Robotics Autom..

[81]  R. Bowden,et al.  Towards automated wide area visual surveillance: tracking objects between spatially-separated, uncalibrated views , 2005 .

[82]  Mohan S. Kankanhalli,et al.  Application Potential of Multimedia Information Retrieval , 2008, Proceedings of the IEEE.

[83]  R. Cucchiara,et al.  Multimedia surveillance: content-based retrieval with multicamera people tracking , 2006, VSSN '06.

[84]  R. Cucchiara.  Multimedia surveillance systems , 2005, VSSN@MM.

[85]  F. Castanedo,et al.  Extending surveillance systems capabilities using BDI cooperative sensor agents , 2006, VSSN '06.

[86]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[87]  Dimitrios Makris,et al.  Time efficient ghost removal for motion detection in visual surveillance systems , 2008 .

[88]  Luca Benini,et al.  An integrated multi-modal sensor network for video surveillance , 2005, VSSN '05.

[89]  Parameswaran Ramanathan,et al.  Distributed target classification and tracking in sensor networks , 2003 .

[90]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[91]  David Akopian,et al.  Reduced complexity acquisition of GPS signals for software embedded applications , 2006 .

[92]  Riad I. Hammoud,et al.  Thermal-Visible Video Fusion for Moving Target Tracking and Pedestrian Classification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[93]  Xiaochun Cao,et al.  Autoconfiguration of a Dynamic Nonoverlapping Camera Network , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[94]  Scott Y. Harmon,et al.  Sensor data fusion through a distributed blackboard , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[95]  Qi Tian,et al.  An Efficient Sequential Approach to Tracking Multiple Objects Through Crowds for Real-Time Intelligent CCTV Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[96]  Mohan S. Kankanhalli,et al.  Information assimilation framework for event detection in multimedia surveillance systems , 2006, Multimedia Systems.

[97]  Kenneth J. Christensen,et al.  A first look at wired sensor networks for video surveillance systems , 2002, 27th Annual IEEE Conference on Local Computer Networks, 2002. Proceedings. LCN 2002..

[98]  Bob Hardian,et al.  Middleware support for transparency and user control in context-aware systems , 2006, MDS '06.

[99]  Yongping Li,et al.  Multiple Biometrics System based on DavinCi Platform , 2008, 2008 International Symposium on Information Science and Engineering.

[100]  Stefania Bandini,et al.  Improving the effectiveness of monitoring and control systems exploiting knowledge-based approaches , 2005, Personal and Ubiquitous Computing.

[101]  P. Atrey,et al.  Timeline-based information assimilation in multimedia surveillance and monitoring systems , 2005, VSSN@MM.

[102]  Yuan Li,et al.  Tracking in Low Frame Rate Video: A Cascade Particle Filter with Discriminative Observers of Different Lifespans , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.