Multi-modal Video Surveillance Aided by Pyroelectric Infrared Sensors

The interest in low-cost and small size video surveillance systems able to collaborate in a network has been increasing over the last years. Thanks to the progress in low-power design, research has greatly reduced the size and the power consumption of such distributed embedded systems providing flexibility, quick deployment and allowing the implementation of effective vision algorithms performing image processing directly on the embedded node. In this paper we present a multi-modal video sensor node designed for low-power and low-cost video surveillance able to detect changes in the environment. The system is equipped with a CMOS video camera and a Pyroelectric InfraRed (PIR) sensor exploited to reduce remarkably the power consumption of the system in absence of events. The on-board microprocessor implements an NCC-based change detection algorithm. We analyze different configurations and characterize the system in terms of runtime execution and power consumption.

[1]  Naoya Ohta,et al.  A statistical approach to background subtraction for surveillance systems , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  K. Zhang,et al.  Using scene-change detection and multiple-thread background memory for efficient video coding , 1999 .

[3]  Shree K. Nayar,et al.  Ordinal Measures for Image Correspondence , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Paul Muralt,et al.  Micromachined infrared detectors based on pyroelectric thin films , 2001 .

[5]  Carlo S. Regazzoni,et al.  A distributed surveillance system for detection of abandoned objects in unmanned railway environments , 2000, IEEE Trans. Veh. Technol..

[6]  FengWu-Chi,et al.  Panoptes: scalable low-power video sensor networking technologies , 2005 .

[7]  Gang Zhou,et al.  VigilNet: An integrated sensor network system for energy-efficient surveillance , 2006, TOSN.

[8]  Federico Tombari,et al.  A robust measure for visual correspondence , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[9]  Michele Magno,et al.  A Solar-powered Video Sensor Node for Energy Efficient Multimodal Surveillance , 2008, 2008 11th EUROMICRO Conference on Digital System Design Architectures, Methods and Tools.

[10]  Paul Lukowicz,et al.  Fin-germouse: A wearable hand tracking system , 2002 .

[11]  Osama Masoud,et al.  Real time, online detection of abandoned objects in public areas , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  Luigi Ferrigno,et al.  A Bluetooth-based proposal of instrument wireless interface , 2005, IEEE Transactions on Instrumentation and Measurement.

[13]  Michael D. Beynon,et al.  Detecting abandoned packages in a multi-camera video surveillance system , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[14]  Bart Kosko,et al.  Neural networks for signal processing , 1992 .

[15]  Jun Rekimoto,et al.  ID CAM: a smart camera for scene capturing and ID recognition , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[16]  Visvanathan Ramesh,et al.  An Intensity-augmented Ordinal Measure for Visual Correspondence , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[18]  R. Engelbrecht,et al.  DIGEST of TECHNICAL PAPERS , 1959 .

[19]  Visvanathan Ramesh,et al.  Sudden illumination change detection using order consistency , 2004, Image Vis. Comput..

[20]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[21]  Luca Benini,et al.  Using a Wireless Sensor Network to Enhance Video Surveillance , 2007 .

[22]  Tiziana D'Orazio,et al.  An Abandoned/Removed Objects Detection Algorithm and Its Evaluation on PETS Datasets , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[23]  Emil Jovanov,et al.  A low power intelligent video-processing sensor , 2002, Proceedings of the Thirty-Fourth Southeastern Symposium on System Theory (Cat. No.02EX540).

[24]  John Heidemann,et al.  Privacy-sensitive monitoring with a mix of ir sensors and cameras , 2003 .

[25]  Joseph A. Paradiso,et al.  Energy scavenging for mobile and wireless electronics , 2005, IEEE Pervasive Computing.

[26]  Jin Liu,et al.  Ultra-low power motion-triggered image sensor for distributed wireless sensor network , 2003, Proceedings of IEEE Sensors 2003 (IEEE Cat. No.03CH37498).

[27]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[28]  K. Najafi,et al.  A wireless integrated microsystem for environmental monitoring , 2004, 2004 IEEE International Solid-State Circuits Conference (IEEE Cat. No.04CH37519).

[29]  Olivier Romain,et al.  Architecture of an intelligent beacon for wireless sensor networks , 2003, 2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718).

[30]  Luigi di Stefano,et al.  Detecting Changes in Grey Level Sequences by ML Isotonic Regression , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[31]  Yu Shi,et al.  Design and implementation of a CMOS sensor based video camera incorporating a combined AWB/AEC module , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..