Intelligent distributed surveillance systems: a review

This survey describes the current state-of-the-art in the development of automated visual surveillance systems so as to provide researchers in the field with a summary of progress achieved to date and to identify areas where further research is needed. The ability to recognise objects and humans, to describe their actions and interactions from information acquired by sensors is essential for automated visual surveillance. The increasing need for intelligent visual surveillance in commercial, law enforcement and military applications makes automated visual surveillance systems one of the main current application domains in computer vision. The emphasis of this review is on discussion of the creation of intelligent distributed automated surveillance systems. The survey concludes with a discussion of possible future directions.

[1]  Carlo S. Regazzoni,et al.  A cooperative multisensor system for face detection in Video Surveillance applications , 2003 .

[2]  Ming Xu,et al.  Architecture and algorithms for tracking football players with multiple cameras , 2005 .

[3]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Sergio A. Velastin,et al.  Fusing Visual and Audio Information in a Distributed Intelligent Surveillance System for Public Transport Systems , 2003 .

[5]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Zeng Zhi.  Lane Detection and Car Tracking on the Highway , 2003 .

[7]  Marco Conti,et al.  Design and analysis of RT-Ring: a protocol for supporting real-time communications , 2002, IEEE Trans. Ind. Electron..

[8]  James E. Black,et al.  A novel method for video tracking performance evaluation , 2003 .

[9]  Mark E. Weber,et al.  Low altitude wind shear detection using airport surveillance radars , 1995 .

[10]  Carlo S. Regazzoni,et al.  Advanced Video-Based Surveillance Systems , 1998 .

[11]  Paolo Remagnino,et al.  VIGILANT: content-querying of video surveillance streams , 2002 .

[12]  Carlo S. Regazzoni,et al.  Network Management Within an Architecture for Distributed Hierarchial Digital Surveillance Systems , 2000 .

[13]  Terrance E. Boult,et al.  Into the woods: visual surveillance of noncooperative and camouflaged targets in complex outdoor settings , 2001, Proc. IEEE.

[14]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Pramod K. Varshney,et al.  Automatic camera selection and fusion for outdoor surveillance under changing weather conditions , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[16]  Jie Huang,et al.  Adaptive live video streaming by priority drop , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[17]  M. Thonnat,et al.  Video sequence interpretation for visual surveillance , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[18]  M P Gardner.  HIGHWAY TRAFFIC MONITORING , 2000 .

[19]  R. A. Grupen,et al.  Towards a real-time framework for visual monitoring tasks , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[20]  J. Batista,et al.  Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking , 1998, Proceedings 1998 IEEE Workshop on Visual Surveillance.

[21]  Robert Pless,et al.  Detecting Independent Motion: The Statistics of Temporal Continuity , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Foster F. Dai,et al.  Enabling multimedia applications for factory automation , 2001, IEEE Trans. Ind. Electron..

[23]  Maria L. Gini,et al.  Performance of a distributed robotic system using shared communications channels , 2002, IEEE Trans. Robotics Autom..

[24]  Wolfram Burgard,et al.  Using EM to learn motion behaviors of persons with mobile robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  George N. Rouskas,et al.  Deterministic Preemtive Scheduling of Real-Time Tasks , 2002, Computer.

[27]  Svetha Venkatesh,et al.  Recognizing and monitoring high-level behaviors in complex spatial environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[28]  Linda Bushnell,et al.  Real-time mixed-traffic wireless networks , 2001, IEEE Trans. Ind. Electron..

[29]  Henry Y. H. Chuang,et al.  A frame-level FSBM motion estimation architecture with large search range , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[30]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[31]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[32]  Vassilios Morellas,et al.  Two Examples of Indoor and Outdoor Surveillance Systems: Motivation, Design, and Testing , 2002 .

[33]  Aaron F. Bobick,et al.  Fast Lighting Independent Background Subtraction , 2004, International Journal of Computer Vision.

[34]  Hui Fang,et al.  Video extraction in compressed domain , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[35]  Donnie Smith,et al.  An IEEE 1394 - FireWire - based embedded video system for surveillance applications , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[36]  Valerio Recagno,et al.  Security in Ports: the User Requirements for Surveillance System , 1999 .

[37]  Ioannis Pavlidis,et al.  Urban surveillance systems: from the laboratory to the commercial world , 2001, Proc. IEEE.

[38]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[39]  Janne Heikkilä,et al.  A real-time system for monitoring of cyclists and pedestrians , 2004, Image Vis. Comput..

[40]  R. Manmatha,et al.  Features for word spotting in historical manuscripts , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[41]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  J. Krumm,et al.  Multi-camera multi-person tracking for EasyLiving , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[43]  Carlo S. Regazzoni,et al.  Content-based retrieval and real time detection from video sequences acquired by surveillance systems , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[44]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Larry S. Davis,et al.  Hydra: multiple people detection and tracking using silhouettes , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[46]  Paul R. Cohen,et al.  A Method for Clustering the Experiences of a Mobile Robot that Accords with Human Judgments , 2000, AAAI/IAAI.

[47]  Lou Jian.  3-D Model Based Visual Traffic Surveillance , 2003 .

[48]  Christian Micheloni,et al.  A cooperative multicamera system for video-surveillance of parking lots , 2003 .

[49]  Tieniu Tan,et al.  An Integrated Traffic and Pedestrian Model-Based Vision System , 1997, BMVC.

[50]  Mohand-Said Hacid,et al.  A Database Approach for Modeling and Querying Video Data , 2000, IEEE Trans. Knowl. Data Eng..

[51]  Andrew Hunter,et al.  Application of the self-organising map to trajectory classification , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[52]  D. M. Gavrilla,et al.  The analysis of human motion and its application for visual surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[53]  Damian M. Lyons,et al.  Visual Surveillance in Retail Stores and in the Home , 2002 .

[54]  Svetha Venkatesh,et al.  Tracking and Surveillance in Wide-Area Spatial Environments Using the Abstract Hidden Markov Model , 2001, Int. J. Pattern Recognit. Artif. Intell..

[55]  Shaogang Gong,et al.  Recognition of group activities using dynamic probabilistic networks , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[56]  Rita Cucchiara,et al.  Using computer vision techniques for dangerous situation detection in domotic applications , 2004 .

[57]  Takushi Sogo,et al.  Monitoring dynamically changing environments by ubiquitous vision system , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[58]  C. Jaynes.  Multi-view calibration from planar motion for video surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[59]  Maja Matijasevic,et al.  A framework for multiuser distributed virtual environments , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[60]  Hung Hai Bui,et al.  Mutliple camera coordination in a surveillance system , 2003 .

[61]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[62]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[63]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[64]  Trevor Darrell,et al.  Robust, real-time people tracking in open environments using integrated stereo, color, and face detection , 1998, Proceedings 1998 IEEE Workshop on Visual Surveillance.

[65]  Zeno Geradts,et al.  Forensic Video Investigation , 2000 .

[66]  Nino Ronetti,et al.  Railway Station Surveillance: The Italian Case , 2000 .

[67]  Gian Luca Foresti,et al.  Special issue on video communications, processing, and understanding for third generation surveillance systems , 2001 .

[68]  Aaron F. Bobick,et al.  Video surveillance of interactions , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[69]  Zehang Sun,et al.  A distributed visual surveillance system , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[70]  Stephen J. Maybank,et al.  Visual Surveillance for Moving Vehicles , 1998, International Journal of Computer Vision.

[71]  Gian Luca Foresti,et al.  Distributed architectures and logical-task decomposition in multimedia surveillance systems , 2001, Proc. IEEE.

[72]  Gian Luca Foresti,et al.  Multimedia Video-Based Surveillance Systems , 2000 .

[73]  Paolo Castelpietra,et al.  Analysis and simulation methods for performance evaluation of a multiple networked embedded architecture , 2002, IEEE Trans. Ind. Electron..

[74]  Dorin Comaniciu,et al.  Design, analysis, and engineering of video monitoring systems: an approach and a case study , 2001, Proc. IEEE.

[75]  Sergio A. Velastin,et al.  An approach for designing a real-time intelligent distributed surveillance system , 2003 .

[76]  Paolo Remagnino,et al.  Multi-camera colour tracking , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[77]  Christopher Nw Agboso.  User focused Surveillance Systems Integration for Intelligent Transport Systems , 1999 .

[78]  José Alberto Fonseca,et al.  The FTT-CAN protocol: why and how , 2002, IEEE Trans. Ind. Electron..