An integrated multi-modal sensor network for video surveillance

To enhance video surveillance systems, multi-modal sensor integration can be a successful strategy. In this work, a computer vision system able to detect and track people from multiple cameras is integrated with a wireless sensor network mounting PIR (Passive InfraRed) sensors. The two subsystems are briefly described and possible cases in which computer vision algorithms are likely to fail are discussed. Then, simple but reliable outputs from the PIR sensor nodes are exploited to improve the accuracy of the vision system. In particular, two case studies are reported: the first uses the presence detection of PIR sensors to disambiguate between an opened door and a moving person, while the second handles motion direction changes during occlusions. Preliminary results are reported and demonstrate the usefulness of the integration of the two subsystems.

[1]  Rita Cucchiara,et al.  Probabilistic posture classification for Human-behavior analysis , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Jiang Li,et al.  Color based multiple people tracking , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[3]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  J. Krumm,et al.  Multi-camera multi-person tracking for EasyLiving , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[5]  Simone Calderara,et al.  Consistent Labeling for Multi-camera Object Tracking , 2005, ICIAP.

[6]  Larry S. Davis,et al.  Unified multi-camera detection and tracking using region-matching , 2001, Proceedings 2001 IEEE Workshop on Multi-Object Tracking.

[7]  Luca Benini,et al.  T-Park: ambient intelligence for security in public parks , 2005 .

[8]  Gian Luca Foresti,et al.  Active Video-Based Surveillance System , 2005 .

[9]  Deborah Estrin,et al.  Guest Editors' Introduction: Overview of Sensor Networks , 2004, Computer.

[10]  John Heidemann,et al.  Privacy-sensitive monitoring with a mix of ir sensors and cameras , 2003 .

[11]  S. De Vlaam.  Object tracking in a multi sensor network , 2004 .

[12]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Ajay Divakaran,et al.  Multi-camera calibration, object tracking and query generation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[14]  D. Mitchell Wilkes,et al.  An application of passive human-robot interaction: human tracking based on attention distraction , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Christopher O. Jaynes.  Multi-view calibration from planar motion trajectories , 2004, Image Vis. Comput..

[16]  Lingqi Zeng,et al.  Multisensor System for Safer Human-Robot Interaction , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Rama Chellappa,et al.  Robust two-camera tracking using homography , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.