Intelligent Resource Allocation in Dense LoRa Networks using Deep Reinforcement Learning

The anticipated increase in the count of IoT devices in the coming years motivates the development of efficient algorithms that can help in their effective management while keeping the power consumption low. In this paper, we propose LoRaDRL and provide a detailed performance evaluation. We propose a multi-channel scheme for LoRaDRL. We perform extensive experiments, and our results demonstrate that the proposed algorithm not only significantly improves long-range wide area network (LoRaWAN)’s packet delivery ratio (PDR) but is also able to support mobile end-devices (EDs) while ensuring lower power consumption. Most previous works focus on proposing different MAC protocols for improving the network capacity. We show that through the use of LoRaDRL, we can achieve the same efficiency with ALOHA while moving the complexity from EDs to the gateway thus making the EDs simpler and cheaper. Furthermore, we test the performance of LoRaDRL under large-scale frequency jamming attacks and show its adaptiveness to the changes in the environment. We show that LoRaDRL’s output improves the performance of state-of-the-art techniques resulting in some cases an improvement of more than 500% in terms of PDR compared to learning-based techniques.

[1]  Utz Roedig,et al.  Do LoRa Low-Power Wide-Area Networks Scale? , 2016, MSWiM.

[2]  Walid Saad,et al.  Jamming in the Internet of Things: A Game-Theoretic Perspective , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[3]  Tommaso Melodia,et al.  Securing the Internet of Things in the Age of Machine Learning and Software-Defined Networking , 2018, IEEE Internet of Things Journal.

[4]  Takeo Fujii,et al.  Q-Learning Aided Resource Allocation and Environment Recognition in LoRaWAN With CSMA/CA , 2019, IEEE Access.

[5]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[6]  H. Vincent Poor,et al.  Two-dimensional anti-jamming communication based on deep reinforcement learning , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Nuno Pereira,et al.  Analysis of LoRaWAN v1.1 security: research paper , 2018, SmartObjects@MobiHoc.

[8]  Hayrettin Evirgen,et al.  A Survey on LoRaWAN Architecture, Protocol and Technologies , 2019, Future Internet.

[9]  Thomas Watteyne,et al.  Understanding the Limits of LoRaWAN , 2016, IEEE Communications Magazine.

[10]  Dirk Pesch,et al.  A Search into a Suitable Channel Access Control Protocol for LoRa-Based Networks , 2018, 2018 IEEE 43rd Conference on Local Computer Networks (LCN).

[11]  Wouter Joosen,et al.  Selective Jamming of LoRaWAN using Commodity Hardware , 2017, MobiQuitous.

[12]  Muhammad Omer Farooq,et al.  LoRaDRL: Deep Reinforcement Learning Based Adaptive PHY Layer Transmission Parameters Selection for LoRaWAN , 2020, 2020 IEEE 45th Conference on Local Computer Networks (LCN).

[13]  Kinda Khawam,et al.  LoRa-MAB: A Flexible Simulator for Decentralized Learning Resource Allocation in IoT Networks , 2019, 2019 12th IFIP Wireless and Mobile Networking Conference (WMNC).

[14]  Petar Solic,et al.  LoRaWAN — A low power WAN protocol for Internet of Things: A review and opportunities , 2017, 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech).

[15]  Dirk Pesch,et al.  $FREE$ —Fine-Grained Scheduling for Reliable and Energy-Efficient Data Collection in LoRaWAN , 2018, IEEE Internet of Things Journal.

[16]  Sofie Pollin,et al.  Range and coexistence analysis of long range unlicensed communication , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[17]  Junaid Qadir,et al.  Artificial Intelligence as an Enabler for Cognitive Self-Organizing Future Networks , 2017, ArXiv.

[18]  Mahesh Sooriyabandara,et al.  Low Power Wide Area Networks: An Overview , 2016, IEEE Communications Surveys & Tutorials.

[19]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[20]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[21]  Zhiwei Zhao,et al.  A Survey on LoRa Networking: Research Problems, Current Solutions, and Open Issues , 2019, IEEE Communications Surveys & Tutorials.

[22]  Prasant Mohapatra,et al.  Security Issues of Low Power Wide Area Networks in the Context of LoRa Networks , 2020, ArXiv.