Sleep Control for Tracking in Sensor Networks

We study the problem of tracking an object moving through a network of wireless sensors. In order to conserve energy, the sensors may be put into a sleep mode with a timer that determines their sleep duration. It is assumed that an asleep sensor cannot be communicated with or woken up, and hence the sleep duration needs to be determined at the time the sensor goes to sleep based on all the information available to the sensor. Having sleeping sensors in the network could result in degraded tracking performance, therefore, there is a tradeoff between energy usage and tracking performance. We design sleeping policies that attempt to optimize this tradeoff and characterize their performance. As an extension to our previous work in this area, we consider generalized models for object movement, object sensing, and tracking cost. For discrete state spaces and continuous Gaussian observations, we derive a lower bound on the optimal energy-tracking tradeoff. It is shown that in the low tracking error regime, the generated policies approach the derived lower bound.

[1]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.

[2]  N. A. Vasanthi,et al.  Energy Saving Schedule for Target Tracking Sensor Networks to Maximize the Network Lifetime , 2006, 2006 1st International Conference on Communication Systems Software & Middleware.

[3]  G. Monahan State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[4]  Wang-Chien Lee,et al.  Prediction-based strategies for energy saving in object tracking sensor networks , 2004, IEEE International Conference on Mobile Data Management, 2004. Proceedings. 2004.

[5]  Biplab Sikdar,et al.  A protocol for tracking mobile targets using sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[6]  H. Robbins A Stochastic Approximation Method , 1951 .

[7]  Parameswaran Ramanathan,et al.  Distributed target classification and tracking in sensor networks , 2003 .

[8]  Prasant Mohapatra,et al.  Virtual patrol: a new power conservation design for surveillance using sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[9]  Venugopal V. Veeravalli,et al.  Energy Efficient Multi-Object Tracking in Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[10]  D. Castañón Approximate dynamic programming for sensor management , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[11]  Prasant Mohapatra,et al.  Power conservation and quality of surveillance in target tracking sensor networks , 2004, MobiCom '04.

[12]  Venugopal V. Veeravalli,et al.  Smart Sleeping Policies for Energy Efficient Tracking in Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[13]  Lizhi Yang,et al.  A Multi-modality Framework for Energy Efficient Tracking in Large Scale Wireless Sensor Networks , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[14]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[15]  Bernard C. Levy,et al.  Principles of Signal Detection and Parameter Estimation , 2008 .

[16]  Milos Hauskrecht,et al.  Value-Function Approximations for Partially Observable Markov Decision Processes , 2000, J. Artif. Intell. Res..

[17]  Arnaud Doucet,et al.  Sequential Monte Carlo Methods , 2006, Handbook of Graphical Models.

[18]  George Atia,et al.  Sensor Scheduling for Energy-Efficient Target Tracking in Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[19]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[20]  Michael L. Littman,et al.  Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes , 1997, UAI.

[21]  Samir R. Das,et al.  Tracking moving targets in a smart sensor network , 2003, 2003 IEEE 58th Vehicular Technology Conference. VTC 2003-Fall (IEEE Cat. No.03CH37484).

[22]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[23]  Kamesh Namuduri,et al.  Distributed and collaborative tracking for energy-constrained ad-hoc wireless sensor networks , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[24]  D. Aberdeen,et al.  A ( Revised ) Survey of Approximate Methods for Solving Partially Observable Markov Decision Processes , 2003 .

[25]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[26]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .