Energy-Aware High Resolution Image Acquisition via Heterogeneous Image Sensors

We present an energy-efficient high resolution image acquisition approach based on a two-tiered system comprising low-cost, low-power, non-actuated, extremely resource-constrained stereo image sensor platforms and more capable but more power-consumptive high resolution imaging platforms with actuation capability. The resource constrained platforms are used to compute 3D object location and subsequently to compute appropriate pan/tilt/zoom settings for the high resolution imaging platforms. The high resolution imaging platforms with actuation capability acquire high resolution images which can be utilized for various recognition purposes. We present a design methodology and system architecture, and evaluate latency and energy tradeoffs in the system. Experimental results show that use of the two-tiered network significantly reduces energy consumption of high resolution image acquisition versus a single-tiered network with minimum loss in detection capability.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  Wayne H. Wolf,et al.  Architectures for distributed smart cameras , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[3]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[4]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Deborah Estrin,et al.  Network of cyclops; image inference and interpretation in sensor network , 2005, SenSys '05.

[7]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[8]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[9]  Dan Schonfeld,et al.  Automatic Object Trajectory-Based Motion Recognition Using Gaussian Mixture Models , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[10]  Richard J. Radke,et al.  Distributed Metric Calibration of Large Camera Networks , 2004 .

[11]  Mohammad H. Rahimi,et al.  Energy-Optimized Image Communication on Resource-Constrained Sensor Platforms , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[12]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[13]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[14]  David E. Culler,et al.  Design of a wireless sensor network platform for detecting rare, random, and ephemeral events , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[15]  Gaurav S. Sukhatme,et al.  Virtual high-resolution for sensor networks , 2006, SenSys '06.

[16]  Joseph A. Paradiso,et al.  Groggy Wakeup - Automated Generation of Power-Efficient Detection Hierarchies for Wearable Sensors , 2007, BSN.

[17]  Andreas Savvides,et al.  Sensor Localization and Camera Calibration using Low Power Cameras , 2005 .

[18]  António de Sousa.  Smart Cameras in Embedded Systems , 2020 .

[19]  Rómer Rosales,et al.  3D trajectory recovery for tracking multiple objects and trajectory guided recognition of actions , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  C. Guestrin,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.