Learning based gain-aware content dissemination in delay tolerant networks

This paper presents a multicast Delay Tolerant Network (DTN) routing protocol with the goal of maximizing an economic gain for Device-to-Device (D2D) commercial content dissemination. The defined economic gain is a composite routing performance index, which combines revenue from delivery, and forwarding cost from disseminating commercial content such as coupons. Majority of existing approaches, due to lack of gain-awareness, cannot control the economic gain of dissemination, as defined in this context. In the proposed approach, which is inspired by Q-learning, nodes are able to learn a set of forwarding actions which lead to a higher expected reward, i.e., gain. Due to the online learning framework, this Q-learning based Gain-aware Routing (QGR) protocol is expected to be robust in diverse and dynamic mobility environments. Using the DTN simulation software ONE, we run experiments for functional validation and performance evaluation of the proposed protocol with respect to two existing competitive protocols under different protocol constraints and mobility scenarios.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  Kok-Lim Alvin Yau,et al.  Application of reinforcement learning to routing in distributed wireless networks: a review , 2013, Artificial Intelligence Review.

[3]  Yan Wang,et al.  Incentive driven information sharing in delay tolerant mobile networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[4]  Subir Biswas,et al.  Economy driven content dissemination in Delay Tolerant Networks , 2014, Ad Hoc Networks.

[5]  Subir Biswas,et al.  Device-to-device commercial content dissemination in social wireless networks , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[6]  Amin Vahdat,et al.  Epidemic Routing for Partially-Connected Ad Hoc Networks , 2009 .

[7]  Paolo Santi,et al.  Social-Aware Stateless Routingin Pocket Switched Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[8]  Ke Xu,et al.  A Survey of Social-Aware Routing Protocols in Delay Tolerant Networks: Applications, Taxonomy and Design-Related Issues , 2014, IEEE Communications Surveys & Tutorials.

[9]  Subir Biswas,et al.  Device-to-device coupon distribution using economic routing utilities , 2016, 2016 IEEE 12th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[10]  Qinghua Li,et al.  Multicasting in delay tolerant networks: a social network perspective , 2009, MobiHoc '09.

[11]  Marília Curado,et al.  A reinforcement learning-based routing for delay tolerant networks , 2013, Eng. Appl. Artif. Intell..

[12]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[13]  Pin-Han Ho,et al.  ARBR: Adaptive reinforcement-based routing for DTN , 2010, 2010 IEEE 6th International Conference on Wireless and Mobile Computing, Networking and Communications.