Deploying SDN Control in Internet of UAVs: Q-Learning-Based Edge Scheduling

Nowadays, wilderness monitoring provides massive data output for supporting agricultural production, environmental protection, and disaster monitoring. However, smart upgrading alone for these wireless nodes cannot meet the softwarized network needs today, relating to the explosion of multi-dimensional data and multi-species equipment. In this article, we conduct a comprehensive solution for the UAV based data collection strategy in an “air-to-ground” intelligent softwarized collection system. The innovation in this article is that after using the IoT nodes to complete the data collection process through the proposed bandwidth-weighted traffic pushing optimization (BWPTO) algorithm, the system infers the future changes according to the current network state using a deep Q-learning (DQL) network. Then, by developing the proposed AIIPO (Air-to-Ground Intelligent Information Pushing Optimization) algorithm, the entire network can “forward-looking” the uploaded information to potentially idle nodes in the future, thus achieve the optimized system performance. Through the final mathematical experiments, we prove the optimality of our proposed routing algorithm and forwarding strategy, which are more applicable in the dynamic “air-to-ground” distributed data collection system than other benchmark solutions.

[1]  Zhu Zhu,et al.  Information Service System Of Agriculture IoT , 2013 .

[2]  Yu Haiyang,et al.  Quick image processing method of HJ satellites applied in agriculture monitoring , 2016, 2016 World Automation Congress (WAC).

[3]  Kaoru Ota,et al.  Enabling Computational Intelligence for Green Internet of Things: Data-Driven Adaptation in LPWA Networking , 2020, IEEE Computational Intelligence Magazine.

[4]  F. Richard Yu,et al.  Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach , 2022, IEEE Transactions on Intelligent Transportation Systems.

[5]  Mianxiong Dong,et al.  MultiSpectralNet: Spectral Clustering Using Deep Neural Network for Multi-View Data , 2019, IEEE Transactions on Computational Social Systems.

[6]  Athanasios V. Vasilakos,et al.  Multimedia Processing Pricing Strategy in GPU-Accelerated Cloud Computing , 2020, IEEE Transactions on Cloud Computing.

[7]  Stephen Anokye,et al.  Machine Learning Based Unmanned Aerial Vehicle Enabled Fog-Radio Access Network and Edge Computing , 2020 .

[8]  Vishal Sharma,et al.  Efficient Deployment with Throughput Maximization for UAVs Communication Networks , 2020, Sensors.

[9]  Jose Ordonez-Lucena,et al.  The Creation Phase in Network Slicing: From a Service Order to an Operative Network Slice , 2018, 2018 European Conference on Networks and Communications (EuCNC).

[10]  Ashraf Matrawy,et al.  Optimal Slice Allocation in 5G Core Networks , 2018, IEEE Networking Letters.

[11]  K. Kathiravan,et al.  An analysis of various routing protocols for Precision Agriculture using Wireless Sensor Network , 2015, 2015 IEEE Technological Innovation in ICT for Agriculture and Rural Development (TIAR).

[12]  Shilin Wen,et al.  Blockchain-Enabled Data Collection and Sharing for Industrial IoT With Deep Reinforcement Learning , 2019, IEEE Transactions on Industrial Informatics.

[13]  Igor Bisio,et al.  Data mining algorithms for communication networks control: concepts, survey and guidelines , 2016, IEEE Network.

[14]  Hirley Alves,et al.  Network Slicing for URLLC and eMBB With Max-Matching Diversity Channel Allocation , 2020, IEEE Communications Letters.

[15]  G. Narendra Kumar,et al.  Monitoring effect of air pollution on agriculture using WSNs , 2017, 2017 IEEE Technological Innovations in ICT for Agriculture and Rural Development (TIAR).

[16]  Haoxiang Wang,et al.  Efficient IoT-based sensor BIG Data collection-processing and analysis in smart buildings , 2017, Future Gener. Comput. Syst..

[17]  Jie Wu,et al.  Homing spread: Community home-based multi-copy routing in mobile social networks , 2013, 2013 Proceedings IEEE INFOCOM.

[18]  Kibet Langat,et al.  Low complexity MMSE channel prediction for block fading channels in LTE downlink , 2015, AFRICON 2015.

[19]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[20]  Hiroyuki Iida,et al.  Computer shogi , 2002, Artif. Intell..

[21]  Mianxiong Dong,et al.  Fine-Grained Management in 5G: DQL Based Intelligent Resource Allocation for Network Function Virtualization in C-RAN , 2020, IEEE Transactions on Cognitive Communications and Networking.

[22]  Panlong Yang,et al.  Charging Oriented Sensor Placement and Flexible Scheduling in Rechargeable WSNs , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[23]  Nei Kato,et al.  On a Novel Deep-Learning-Based Intelligent Partially Overlapping Channel Assignment in SDN-IoT , 2018, IEEE Communications Magazine.

[24]  Syeda Ayesha Anwar,et al.  A scrum based framework for e-agriculture system , 2014, 17th IEEE International Multi Topic Conference 2014.

[25]  Antonio Iera,et al.  Energy Efficient IoT Data Collection in Smart Cities Exploiting D2D Communications , 2016, Sensors.

[26]  Angelos Antonopoulos,et al.  Online VNF Lifecycle Management in an MEC-Enabled 5G IoT Architecture , 2020, IEEE Internet of Things Journal.

[27]  Guolin Sun,et al.  Dynamic Reservation and Deep Reinforcement Learning based Autonomous Resource Management for wireless Virtual Networks , 2018, 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC).

[28]  Sheng Wu,et al.  Deep reinforcement learning based joint edge resource management in maritime network , 2020, China Communications.

[29]  Luis Sanabria-Russo,et al.  NFV-Enabled Experimental Platform for 5G Tactile Internet Support in Industrial Environments , 2020, IEEE Transactions on Industrial Informatics.

[30]  Igor Bisio,et al.  Statistical Analysis of Wireless Traffic: An Adversarial Approach to Drone Surveillance , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[31]  Chen Qi,et al.  Deep Reinforcement Learning With Discrete Normalized Advantage Functions for Resource Management in Network Slicing , 2019, IEEE Communications Letters.

[32]  Zhu Han,et al.  Mean Field Deep Reinforcement Learning for Fair and Efficient UAV Control , 2021, IEEE Internet of Things Journal.