Multiple Perspective Interactive Video Surveillance and Monitoring System

Abstract : This report describes a technique for gathering information from a multitude of sensors in a given environment, and integrating it into a coherent and comprehensive Environment Model (EM). The focus of this effort is on the use of Multiple Perspective Interactive Video technology for intelligent video monitoring of environments. The technology developed was applied to two scenarios: the surveillance of a room used as a library and the surveillance of a parking lot. An overall architecture was developed, one for each scenario. For the first scenario (library), four cameras were used to monitor the activity in the room. The system worked on two PCs and monitored activity like "stealing an object," "loitering near a bookshelf," and "jumping on a table." The second scenario (parking lot), included three cameras. The system monitored activity like pedestrians going near several cars, cars entering the parking lot at excessive speed,, and cars remaining in the same spot for more than a specified amount of time.

[1]  Larry S. Davis,et al.  W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[2]  Jake K. Aggarwal,et al.  Tracking human motion using multiple cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Donald Reid An algorithm for tracking multiple targets , 1978 .

[6]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..