Joint Energy Allocation for Sensing and Transmission in Rechargeable Wireless Sensor Networks

Different from a traditional wireless sensor network (WSN) powered by nonrechargeable batteries, the energy management policy of a rechargeable WSN needs to take into account the process of energy harvesting. In this paper, we study the energy allocation for sensing and transmission in an energy harvesting sensor node with a rechargeable battery and a finite data buffer. The sensor aims to maximize the expected total amount of data transmitted until the sensor stops functioning subject to time-varying energy harvesting rate, energy availability in the battery, data availability in the data buffer, and channel fading. Since the lifetime of the sensor is a random variable, we formulate the energy allocation problem as an infinite-horizon Markov decision process (MDP), and propose an optimal energy allocation (OEA) algorithm using the value iteration. We then consider a special case with infinite data backlog and prove that the optimal transmission energy allocation (OTEA) policy is monotonic with respect to the amount of battery energy available. Finally, we conduct extensive simulations to compare the performance of our OEA algorithm, OTEA algorithm, the finite-horizon transmission energy allocation (FHTEA) algorithm extended from [2], and the finite-horizon OEA (FHOEA) algorithm from [1]. Simulation results show that the OEA algorithm transmits the largest amount of data, and the OTEA algorithm can achieve a near-optimal performance with low computational complexity.

[1]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[2]  Leslie Pack Kaelbling,et al.  On the Complexity of Solving Markov Decision Problems , 1995, UAI.

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[4]  John N. Tsitsiklis,et al.  Simulation-based optimization of Markov reward processes , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[5]  Saleem A. Kassam,et al.  Finite-state Markov model for Rayleigh fading channels , 1999, IEEE Trans. Commun..

[6]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[7]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[8]  Mark A. Shayman,et al.  Multitime scale Markov decision processes , 2003, IEEE Trans. Autom. Control..

[9]  R. Amir.  Supermodularity and Complementarity in Economics: An Elementary Survey , 2003 .

[10]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[11]  Xun Wang,et al.  Lifetime optimization of sensor networks under physical attacks , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[12]  Xun Wang,et al.  Search-based physical attacks in sensor networks , 2005, Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005..

[13]  A. García-Armada.  SNR gap approximation for M-PSK-Based bit loading , 2006 .

[14]  Ana Garc ´ ia-Armada.  SNR Gap Approximation for M-PSK-Based Bit Loading , 2006 .

[15]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[16]  Ana García Armada,et al.  SNR gap approximation for M-PSK-Based bit loading , 2006, IEEE Trans. Wirel. Commun..

[17]  Ana García Armada,et al.  An Energy-Efficient Adaptive Modulation Suitable for Wireless Sensor Networks with SER and Throughput Constraints , 2007, EURASIP J. Wirel. Commun. Netw..

[18]  Vijay K. Bhargava,et al.  Wireless sensor networks with energy harvesting technologies: a game-theoretic approach to optimal energy management , 2007, IEEE Wireless Communications.

[19]  Mani B. Srivastava,et al.  Power management in energy harvesting sensor networks , 2007, TECS.

[20]  Koushik Kar,et al.  Rechargeable sensor activation under temporally correlated events , 2009, Wirel. Networks.

[21]  Roy D. Yates,et al.  A generic model for optimizing single-hop transmission policy of replenishable sensors , 2009, IEEE Transactions on Wireless Communications.

[22]  Chin Keong Ho,et al.  Markovian models for harvested energy in wireless communications , 2010, 2010 IEEE International Conference on Communication Systems.

[23]  Rui Zhang,et al.  Optimal energy allocation for wireless communications powered by energy harvesters , 2010, 2010 IEEE International Symposium on Information Theory.

[24]  Vinod Sharma,et al.  Optimal energy management policies for energy harvesting sensor nodes , 2008, IEEE Transactions on Wireless Communications.

[25]  Leandros Tassiulas,et al.  Control of wireless networks with rechargeable batteries [transactions papers] , 2010, IEEE Transactions on Wireless Communications.

[26]  Prasun Sinha,et al.  Joint Energy Management and Resource Allocation in Rechargeable Sensor Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[27]  Ness B. Shroff,et al.  Finite-horizon energy allocation and routing scheme in rechargeable sensor networks , 2011, 2011 Proceedings IEEE INFOCOM.

[28]  Roberto Di Pietro,et al.  Introducing epidemic models for data survivability in Unattended Wireless Sensor Networks , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[29]  Jing Yang,et al.  Adaptive transmission policies for energy harvesting wireless nodes in fading channels , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[30]  Purushottam Kulkarni,et al.  Energy Harvesting Sensor Nodes: Survey and Implications , 2011, IEEE Communications Surveys & Tutorials.

[31]  Biplab Sikdar,et al.  Relay Scheduling for Cooperative Communications in Sensor Networks with Energy Harvesting , 2011, IEEE Transactions on Wireless Communications.

[32]  Elza Erkip,et al.  Energy Management Policies for Energy-Neutral Source-Channel Coding , 2011, IEEE Transactions on Communications.

[33]  Vincent W. S. Wong,et al.  An optimal energy allocation algorithm for energy harvesting wireless sensor networks , 2012, 2012 IEEE International Conference on Communications (ICC).

[34]  Anthony Ephremides,et al.  Optimal packet scheduling for energy harvesting sources on time varying wireless channels , 2012, Journal of Communications and Networks.

[35]  Ness B. Shroff,et al.  A Simple Asymptotically Optimal Joint Energy Allocation and Routing Scheme in Rechargeable Sensor Networks , 2014, IEEE/ACM Transactions on Networking.

[36]  Xiaodong Wang,et al.  Communication of Energy Harvesting Tags , 2012, IEEE Transactions on Communications.

[37]  C. E. Koksal,et al.  Near Optimal Power and Rate Control of Multi-Hop Sensor Networks With Energy Replenishment: Basic Limitations With Finite Energy and Data Storage , 2012, IEEE Transactions on Automatic Control.

[38]  Ness B. Shroff,et al.  A simple asymptotically optimal energy allocation and routing scheme in rechargeable sensor networks , 2012, INFOCOM.

[39]  Koushik Kar,et al.  Optimal Routing and Scheduling in Multihop Wireless Renewable Energy Networks , 2013, IEEE Transactions on Automatic Control.

[40]  Longbo Huang,et al.  Utility Optimal Scheduling in Energy-Harvesting Networks , 2010, IEEE/ACM Transactions on Networking.

[41]  Mingyan Liu,et al.  When simplicity meets optimality: Efficient transmission power control with stochastic energy harvesting , 2013, 2013 Proceedings IEEE INFOCOM.

[42]  Can Emre Koksal,et al.  Basic Performance Limits and Tradeoffs in Energy-Harvesting Sensor Nodes With Finite Data and Energy Storage , 2010, IEEE/ACM Transactions on Networking.

[43]  Deniz Gündüz,et al.  A Learning Theoretic Approach to Energy Harvesting Communication System Optimization , 2012, IEEE Transactions on Wireless Communications.

[44]  Gil Zussman,et al.  Networking Low-Power Energy Harvesting Devices: Measurements and Algorithms , 2011, IEEE Transactions on Mobile Computing.