A low-bandwidth camera sensor platform with applications in smart camera networks

Smart camera networks have recently emerged as a new class of sensor network infrastructure that is capable of supporting high-power in-network signal processing and enabling a wide range of applications. In this article, we provide an exposition of our efforts to build a low-bandwidth wireless camera network platform, called CITRIC, and its applications in smart camera networks. The platform integrates a camera, a microphone, a frequency-scalable (up to 624 MHz) CPU, 16 MB FLASH, and 64 MB RAM onto a single device. The device then connects with a standard sensor network mote to form a wireless camera mote. With reasonably low power consumption and extensive algorithmic libraries running on a decent operating system that is easy to program, CITRIC is ideal for research and applications in distributed image and video processing. Its capabilities of in-network image processing also reduce communication requirements, which has been high in other existing camera networks with centralized processing. Furthermore, the mote easily integrates with other low-bandwidth sensor networks via the IEEE 802.15.4 protocol. To justify the utility of CITRIC, we present several representative applications. In particular, concrete research results will be demonstrated in two areas, namely, distributed coverage hole identification and distributed object recognition.

[1]  Andreas Terzis,et al.  Distributed pose averaging in camera networks via consensus on SE(3) , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[2]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, MULTIMEDIA '05.

[3]  Panu Turcot,et al.  Better matching with fewer features: The selection of useful features in large database recognition problems , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[4]  Qi Qi,et al.  Wireless sensor networks in intelligent transportation systems , 2009, Wirel. Commun. Mob. Comput..

[5]  Luc Van Gool,et al.  Integrating multiple model views for object recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Miodrag Potkonjak,et al.  Coverage problems in wireless ad-hoc sensor networks , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[7]  Simone Calderara,et al.  Entry edge of field of view for multi-camera tracking in distributed video surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[8]  Bir Bhanu,et al.  VideoWeb: Design of a wireless camera network for real-time monitoring of activities , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[9]  Gary Bradski,et al.  Learning-Based Computer Vision with Intels Open Source Computer Vision Library , 2005 .

[10]  Ming-Hsuan Yang,et al.  Traffic modeling and prediction using camera sensor networks , 2010, ICDSC '10.

[11]  Senem Velipasalar,et al.  Detection of composite events spanning multiple camera views with wireless embedded smart cameras , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[12]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Ramin Zabih,et al.  Bayesian multi-camera surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Rama Chellappa,et al.  Modeling and Visualization of Human Activities for Multicamera Networks , 2009, EURASIP J. Image Video Process..

[15]  Andreas Savvides,et al.  Macroscopic Human Behavior Interpretation Using Distributed Imager and Other Sensors , 2008, Proceedings of the IEEE.

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  Bernd Girod,et al.  CHoG: Compressed histogram of gradients A low bit-rate feature descriptor , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[19]  Subhransu Maji,et al.  Multiple-view object recognition in band-limited distributed camera networks , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[20]  Gyula Simon,et al.  The flooding time synchronization protocol , 2004, SenSys '04.

[21]  Allen Y. Yang,et al.  Fast ℓ1-minimization algorithms and an application in robust face recognition: A review , 2010, 2010 IEEE International Conference on Image Processing.

[22]  David E. Culler,et al.  Telos: enabling ultra-low power wireless research , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[23]  Bart De Schutter,et al.  IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS Editor-In-Chief , 2005 .

[24]  Hamid Aghajan,et al.  Development of a Mote for Wireless Image Sensor Networks , 2006 .

[25]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[26]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[27]  Vin de Silva,et al.  HOMOLOGICAL SENSOR NETWORKS , 2005 .

[28]  S. Shankar Sastry,et al.  Poster abstract: Multihop routing in camera sensor networks - An experimental study , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[29]  Bernd Girod,et al.  CHoG: Compressed histogram of gradients A low bit-rate feature descriptor , 2009, CVPR.

[30]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[31]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[32]  Eugenio Culurciello,et al.  A Lightweight Camera Sensor Network Operating on Symbolic Information , 2006 .

[33]  Boleslaw K. Szymanski,et al.  Event Recognition in Sensor Networks by Means of Grammatical Inference , 2009, IEEE INFOCOM 2009.

[34]  Dan Roth,et al.  Learning a Sparse Representation for Object Detection , 2002, ECCV.

[35]  Enrico Magli,et al.  Distributed Compressed Sensing , 2015 .

[36]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[37]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  S. Shankar Sastry,et al.  Algebraic approach to recovering topological information in distributed camera networks , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[39]  Allen Y. Yang,et al.  Towards an efficient distributed object recognition system in wireless smart camera networks , 2010, 2010 13th International Conference on Information Fusion.

[40]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[41]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[42]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[43]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[44]  Bernhard Rinner,et al.  The evolution from single to pervasive smart cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[45]  Agathoniki Trigoni,et al.  Correlation-based data dissemination in traffic monitoring sensor networks , 2006, CoNEXT '06.

[46]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[47]  Bernd Girod,et al.  Tree Histogram Coding for Mobile Image Matching , 2009, 2009 Data Compression Conference.

[48]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[49]  Senem Velipasalar,et al.  Cooperative Object Tracking and Composite Event Detection With Wireless Embedded Smart Cameras , 2010, IEEE Transactions on Image Processing.

[50]  S. Shankar Sastry,et al.  A Distributed Topological Camera Network Representation for Tracking Applications , 2010, IEEE Transactions on Image Processing.

[51]  Amit K. Roy-Chowdhury,et al.  Robust Tracking in A Camera Network: A Multi-Objective Optimization Framework , 2008, IEEE Journal of Selected Topics in Signal Processing.

[52]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[53]  Philip Levis,et al.  Collection tree protocol , 2009, SenSys '09.

[54]  Richard P. Kleihorst,et al.  Camera Mote with a High-Performance Parallel Processor for Real-Time Frame-Based Video Processing , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[55]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[56]  Pai H. Chou,et al.  eCAM: ultra compact, high data-rate wireless sensor node with a miniature camera , 2006, SenSys '06.

[57]  Anthony Rowe,et al.  DSPcam: A camera sensor system for surveillance networks , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[58]  Andrew Gilbert,et al.  Tracking Objects Across Cameras by Incrementally Learning Inter-camera Colour Calibration and Patterns of Activity , 2006, ECCV.

[59]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[60]  David I. Perrett,et al.  Modeling visual recognition from neurobiological constraints , 1994, Neural Networks.

[61]  Alexandre Bernardino,et al.  Detection and classification of highway lanes using vehicle motion trajectories , 2006, IEEE Transactions on Intelligent Transportation Systems.

[62]  Michael J. Brooks,et al.  A Stochastic Approach to Tracking Objects Across Multiple Cameras , 2004, Australian Conference on Artificial Intelligence.

[63]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..