Cyclops: in situ image sensing and interpretation in wireless sensor networks

Despite their increasing sophistication, wireless sensor networks still do not exploit the most powerful of the human senses: vision. Indeed, vision provides humans with unmatched capabilities to distinguish objects and identify their importance. Our work seeks to provide sensor networks with similar capabilities by exploiting emerging, cheap, low-power and small form factor CMOS imaging technology. In fact, we can go beyond the stereo capabilities of human vision, and exploit the large scale of sensor networks to provide multiple, widely different perspectives of the physical phenomena.To this end, we have developed a small camera device called Cyclops that bridges the gap between the computationally constrained wireless sensor nodes such as Motes, and CMOS imagers which, while low power and inexpensive, are nevertheless designed to mate with resource-rich hosts. Cyclops enables development of new class of vision applications that span across wireless sensor network. We describe our hardware and software architecture, its temporal and power characteristics and present some representative applications.

[1]  Eric R. Fossum,et al.  Digital camera system on a chip , 1998, IEEE Micro.

[2]  David E. Culler,et al.  The nesC language: A holistic approach to networked embedded systems , 2003, PLDI.

[3]  Frank Zhao,et al.  Distributed Attention for Large Video Sensor Networks , 2004 .

[4]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[5]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[6]  David E. Culler,et al.  Telos: enabling ultra-low power wireless research , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[7]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[8]  A.P. Chandrakasan,et al.  An ultra low power adaptive wavelet video encoder with integrated memory , 2000, IEEE Journal of Solid-State Circuits.

[9]  W.J. Kaiser,et al.  Sensing uncertainty reduction using low complexity actuation , 2003, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[10]  A. El Gamal,et al.  Trends in CMOS image sensor technology and design , 2002, Digest. International Electron Devices Meeting,.

[11]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[12]  M. Panaghiston,et al.  A miniature imaging module for mobile applications , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[13]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[14]  C. Mouli,et al.  CMOS imager technology shrinks and image performance , 2004, 2004 IEEE Workshop on Microelectronics and Electron Devices.

[15]  Anantha P. Chandrakasan,et al.  A low power chipset for portable multimedia applications , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[16]  Keith Michael Findlater CMOS camera employing a double junction active pixel , 2001 .

[17]  Satish Kumar,et al.  Next century challenges: scalable coordination in sensor networks , 1999, MobiCom.

[18]  Jerry Zhao,et al.  Habitat monitoring: application driver for wireless communications technology , 2001, CCRV.