Mobile delay‐tolerant networks with energy‐harvesting and wireless energy transfer cooperation

We consider a mobile delay‐tolerant networks (MDTNs) with energy‐harvesting capabilities. In order to determine energy management policies that will improve network capacity and packet delivery ratio and maximize the system throughput, we consider a source node that seeks to send packets to a destination node. The optimal policy for the source varies according to its system state, which allows it to guarantee a maximum delivery probability rate. Our problem is modeled by decision theory; as a start, we are interested in the MDP to model and solve such sequential decision problems. Our goal is to optimize for each node, a utility depending on a random environment and decisions made by the node. As the MDP formalism reaches its limits when it is necessary to take into account the interactions between different several nodes, we will start using the graph‐based MDP where the state and action spaces are factorizable by variables. The transition functions and rewards are then decomposed into local functions and the dependency relations between the nodes are represented by a graph. To calculate the optimal policy, we propose Mean Field Approximation (MFA) and Approximate linear‐programming (ALP) algorithms for solving GMDP problem.

[1]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[2]  Essaid Sabir,et al.  A coalitional-game-based incentive mechanism for content caching in heterogeneous Delay Tolerant Networks , 2015, 2015 International Wireless Communications and Mobile Computing Conference (IWCMC).

[3]  Essaid Sabir,et al.  A ferry-assisted solution for forwarding function in Wireless Sensor Networks , 2014, 2014 IEEE Symposium on Computers and Communications (ISCC).

[4]  Eitan Altman Competition and Cooperation between Nodes in Delay Tolerant Networks with Two Hop Routing , 2009, NET-COOP.

[5]  Dusit Niyato,et al.  Sleep and Wakeup Strategies in Solar-Powered Wireless Sensor/Mesh Networks: Performance Analysis and Optimization , 2007, IEEE Transactions on Mobile Computing.

[6]  Yue Lu,et al.  Opportunistic forwarding in energy harvesting mobile delay tolerant networks , 2014, 2014 IEEE International Conference on Communications (ICC).

[7]  P. B. Coaker,et al.  Applied Dynamic Programming , 1964 .

[8]  Nathalie Peyrard,et al.  Mean Field Approximation of the Policy Iteration Algorithm for Graph-Based Markov Decision Processes , 2006, ECAI.

[9]  Zhu Han,et al.  Resource allocation in wireless networks with RF energy harvesting and transfer , 2014, IEEE Network.

[10]  Sudarshan Guruacharya,et al.  Self-Sustainability of Energy Harvesting Systems: Concept, Analysis, and Design , 2017, IEEE Transactions on Green Communications and Networking.

[11]  Derrick Wing Kwan Ng,et al.  Wireless Information and Power Transfer: Energy Efficiency Optimization in OFDMA Systems , 2013, IEEE Transactions on Wireless Communications.

[12]  Ali A. Nasir,et al.  Relaying Protocols for Wireless Energy Harvesting and Information Processing , 2012, IEEE Transactions on Wireless Communications.

[13]  Essaid Sabir,et al.  A college admissions game for content caching in heterogeneous delay tolerant networks , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[14]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[15]  Nathalie Peyrard,et al.  A framework and a mean-field algorithm for the local control of spatial processes , 2012, Int. J. Approx. Reason..

[16]  Sanjay Jha,et al.  Fair Scheduling for Data Collection in Mobile Sensor Networks with Energy Harvesting , 2016, IEEE Transactions on Mobile Computing.

[17]  Kaibin Huang,et al.  Energy Harvesting Wireless Communications: A Review of Recent Advances , 2015, IEEE Journal on Selected Areas in Communications.

[18]  Walid Saad,et al.  A college admissions game for uplink user association in wireless small cell networks , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[19]  Walid Saad,et al.  Cooperation in Delay-Tolerant Networks With Wireless Energy Transfer: Performance Analysis and Optimization , 2015, IEEE Transactions on Vehicular Technology.

[20]  Jalel Ben-Othman,et al.  Graph-Based MDP to Mobile Source with Energy Harvesting in Delay Tolerant Networks System , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[21]  Zhu Han,et al.  Resource Allocation in Wireless Powered Relay Networks: A Bargaining Game Approach , 2016, IEEE Transactions on Vehicular Technology.

[22]  D. Chandler,et al.  Introduction To Modern Statistical Mechanics , 1987 .

[23]  Jun Zhang The mean field theory in EM procedures for Markov random fields , 1992, IEEE Trans. Signal Process..

[24]  Purushottam Kulkarni,et al.  Energy Harvesting Sensor Nodes: Survey and Implications , 2011, IEEE Communications Surveys & Tutorials.