Optimal Energy Management Policy of Mobile Energy Gateway

With the advancement of wireless energy harvesting and transfer technologies, e.g., radio frequency (RF) energy, mobile nodes are fully untethered as energy supply is more ubiquitous. The mobile nodes can receive energy from wireless chargers, which can be static or mobile. In this paper, we introduce the use of a mobile energy gateway that can receive energy from a fixed charging facility, as well as move and transfer energy to other users. The mobile energy gateway aims to maximize the utility by optimally taking energy charging/transferring actions. We formulate the optimal energy charging/transferring problem as a Markov decision process (MDP). The MDP model is then solved to obtain the optimal energy management policy for the mobile energy gateway. Furthermore, the optimal energy management policy obtained from the MDP model is proven to have a threshold structure. We conduct an extensive performance evaluation of the MDP-based energy management scheme. The proposed MDP-based scheme outperforms several conventional baseline schemes in terms of expected overall utility.

[1]  Henrique M Reis,et al.  An interdisciplinary effort to develop a wireless embedded sensor system to monitor and assess corrosion in the tendons of prestressed concrete girders , 2003, 2003 IEEE Topical Conference on Wireless Communication Technology.

[2]  Vikram Krishnamurthy,et al.  Optimality of threshold policies for transmission scheduling in correlated fading channels , 2009, IEEE Transactions on Communications.

[3]  Swades De,et al.  Experimental demonstration of multi-hop RF energy transfer , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[4]  Biplab Sikdar,et al.  Energy efficient transmission strategies for Body Sensor Networks with energy harvesting , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[5]  Sebastien Rondineau,et al.  A conformal 10 GHz rectenna for wireless powering of piezoelectric sensor electronics , 2005, IMS 2005.

[6]  Regan Zane,et al.  Low-Power Far-Field Wireless Powering for Wireless Sensors , 2013, Proceedings of the IEEE.

[7]  Vinod Sharma,et al.  Optimal energy management policies for energy harvesting sensor nodes , 2008, IEEE Transactions on Wireless Communications.

[8]  Deniz Gündüz,et al.  Designing intelligent energy harvesting communication systems , 2014, IEEE Communications Magazine.

[9]  Zhu Han,et al.  Wireless Networks With RF Energy Harvesting: A Contemporary Survey , 2014, IEEE Communications Surveys & Tutorials.

[10]  Zhihua Wang,et al.  An Energy-Efficient ASIC for Wireless Body Sensor Networks in Medical Applications , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[11]  Dusit Niyato,et al.  Offloading in Mobile Cloudlet Systems with Intermittent Connectivity , 2015, IEEE Transactions on Mobile Computing.

[12]  H. T. Mouftah,et al.  Suresense: sustainable wireless rechargeable sensor networks for the smart grid , 2012, IEEE Wireless Communications.

[13]  Dusit Niyato,et al.  Optimizations of Power Consumption and Supply in the Smart Grid: Analysis of the Impact of Data Communication Reliability , 2013, IEEE Transactions on Smart Grid.

[14]  W.T. Jewell,et al.  Analysis of the Cost per Kilowatt Hour to Store Electricity , 2008, IEEE Transactions on Energy Conversion.

[15]  H. T. Mouftah,et al.  DRIFT: Differentiated RF Power Transmission for Wireless Sensor Network deployment in the smart grid , 2012, 2012 IEEE Globecom Workshops.

[16]  Dmitri Moltchanov,et al.  Distance distributions in random networks , 2012, Ad Hoc Networks.

[17]  Rui Zhang,et al.  MIMO Broadcasting for Simultaneous Wireless Information and Power Transfer , 2013 .

[18]  Ahmed Sultan.  Sensing and Transmit Energy Optimization for an Energy Harvesting Cognitive Radio , 2012, IEEE Wireless Communications Letters.

[19]  R. Bellman.  A Markovian Decision Process , 1957 .

[20]  Hubregt J. Visser,et al.  RF Energy Harvesting and Transport for Wireless Sensor Network Applications: Principles and Requirements , 2013, Proceedings of the IEEE.

[21]  Hwee Pink Tan,et al.  QoS-aware data transmission and wireless energy transfer: Performance modeling and optimization , 2014, 2014 IEEE Wireless Communications and Networking Conference (WCNC).

[22]  Pedram Mokrian,et al.  A Stochastic Programming Framework for the Valuation of Electricity Storage , 2022 .

[23]  Jiming Chen,et al.  Minimizing charging delay in wireless rechargeable sensor networks , 2013, 2013 Proceedings IEEE INFOCOM.

[24]  Leslie Pack Kaelbling,et al.  On the Complexity of Solving Markov Decision Problems , 1995, UAI.

[25]  Yoshihiro Kawahara,et al.  Prototype implementation of ambient RF energy harvesting wireless sensor networks , 2010, 2010 IEEE Sensors.

[26]  Hanif D. Sherali,et al.  On renewable sensor networks with wireless energy transfer , 2011, 2011 Proceedings IEEE INFOCOM.

[27]  Vikram Krishnamurthy,et al.  Monotonicity of Constrained Optimal Transmission Policies in Correlated Fading Channels With ARQ , 2010, IEEE Transactions on Signal Processing.

[28]  Xiao Lu,et al.  Dynamic spectrum access in cognitive radio networks with RF energy harvesting , 2014, IEEE Wireless Communications.

[29]  Mohamed K. Watfa,et al.  Multi-Hop Wireless Energy Transfer in WSNs , 2011, IEEE Communications Letters.