UAV-Assisted Communication in Remote Disaster Areas Using Imitation Learning

The damage to cellular towers during natural and man-made disasters can disturb the communication services for cellular users. One solution to the problem is using unmanned aerial vehicles to augment the desired communication network. The paper demonstrates the design of a UAV-Assisted Imitation Learning (UnVAIL) communication system that relays the cellular users’ information to a neighbor base station. Since the user equipment (UEs) are equipped with buffers with limited capacity to hold packets, UnVAIL alternates between different UEs to reduce the chance of buffer overflow, positions itself optimally close to the selected UE to reduce service time, and uncovers a network pathway by acting as a relay node. UnVAIL utilizes Imitation Learning (IL) as a data-driven behavioral cloning approach to accomplish an optimal scheduling solution. Results demonstrate that UnVAIL performs similar to a human expert knowledge-based planning in communication timeliness, position accuracy, and energy consumption with an accuracy of 97.52% when evaluated on a developed simulator to train the UAV.

[1]  Abolfazl Razi,et al.  Aerial Imagery Pile burn detection using Deep Learning: the FLAME dataset , 2020, Comput. Networks.

[2]  Fatemeh Afghah,et al.  A survey on physical unclonable function (PUF)-based security solutions for Internet of Things , 2020, Comput. Networks.

[3]  Fatemeh Afghah,et al.  Wildfire Spread Modeling with Aerial Image Processing , 2020, 2020 IEEE 21st International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[4]  Laurent Njilla,et al.  Cooperative Spectrum Sharing and Trust Management in IoT Networks , 2020, Modeling and Design of Secure Internet of Things.

[5]  Imran Khan,et al.  Performance Evaluation of UAV-Enabled LoRa Networks for Disaster Management Applications , 2020, Sensors.

[6]  Piyush Kumar Shukla,et al.  An adaptive Flying Ad-hoc Network (FANET) for disaster response operations to improve quality of service (QoS) , 2020 .

[7]  Derrick Wing Kwan Ng,et al.  Energy-Efficient Buffer-Aided Relaying Systems With Opportunistic Spectrum Access , 2020, IEEE Transactions on Green Communications and Networking.

[8]  Mehdi Bennis,et al.  Intelligent Edge: Leveraging Deep Imitation Learning for Mobile Edge Computation Offloading , 2020, IEEE Wireless Communications.

[9]  Jeffrey Homola,et al.  Supporting Disaster Relief Operations through UTM: Operational Concept and Flight Tests of Unmanned and Manned Vehicles at a Disaster Drill , 2020 .

[10]  Fatemeh Afghah,et al.  An Autonomous Spectrum Management Scheme for Unmanned Aerial Vehicle Networks in Disaster Relief Operations , 2019, IEEE Access.

[11]  Rong Li,et al.  Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning , 2019, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[12]  Geoffrey Y. Li,et al.  Learning to Branch: Accelerating Resource Allocation in Wireless Networks , 2019, IEEE Transactions on Vehicular Technology.

[13]  Liang Xiao,et al.  UAV-Aided Cellular Communications with Deep Reinforcement Learning Against Jamming , 2018, IEEE Wireless Communications.

[14]  Erik Blasch,et al.  Methods of AI for Multimodal Sensing and Action for Complex Situations , 2019, AI Mag..

[15]  Hoang Duong Tuan,et al.  Learning-Aided Realtime Performance Optimisation of Cognitive UAV-Assisted Disaster Communication , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[16]  Symeon Papavassiliou,et al.  Disaster Management and Information Transmission Decision-Making in Public Safety Systems , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[17]  Fatemeh Afghah,et al.  Fire Frontline Monitoring by Enabling UAV-Based Virtual Reality with Adaptive Imaging Rate , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[18]  Qianqian Zhang,et al.  Reflections in the Sky: Millimeter Wave Communication with UAV-Carried Intelligent Reflectors , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[19]  Gan Zheng,et al.  Optimum Deployment of Multiple UAVs for Coverage Area Maximization in the Presence of Co-Channel Interference , 2019, IEEE Access.

[20]  Francesca Cuomo,et al.  HIRO-NET: Self-Organized Robotic Mesh Networking for Internet Sharing in Disaster Scenarios , 2019, 2019 IEEE 20th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[21]  Mehdi Bennis,et al.  Massive Autonomous UAV Path Planning: A Neural Network Based Mean-Field Game Theoretic Approach , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[22]  Andrey V. Savkin,et al.  A Method for Optimized Deployment of Unmanned Aerial Vehicles for Maximum Coverage and Minimum Interference in Cellular Networks , 2019, IEEE Transactions on Industrial Informatics.

[23]  Abolfazl Razi,et al.  A Solution for Dynamic Spectrum Management in Mission-Critical UAV Networks , 2019, ArXiv.

[24]  Abolfazl Razi,et al.  Wildfire Monitoring in Remote Areas using Autonomous Unmanned Aerial Vehicles , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[25]  Weidang Lu,et al.  UAV-Assisted Emergency Networks in Disasters , 2019, IEEE Wireless Communications.

[26]  Abolfazl Razi,et al.  Distributed Cooperative Spectrum Sharing in UAV Networks Using Multi-Agent Reinforcement Learning , 2018, 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[27]  Walid Saad,et al.  A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems , 2018, IEEE Communications Surveys & Tutorials.

[28]  Ursula Challita,et al.  Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial , 2017, IEEE Communications Surveys & Tutorials.

[29]  Sergey Andreev,et al.  Flexible and Reliable UAV-Assisted Backhaul Operation in 5G mmWave Cellular Networks , 2018, IEEE Journal on Selected Areas in Communications.

[30]  G. Reiner,et al.  A drone fleet model for last-mile distribution in disaster relief operations , 2018, International Journal of Disaster Risk Reduction.

[31]  Symeon Papavassiliou,et al.  Self-Adaptive Energy Efficient Operation in UAV-Assisted Public Safety Networks , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[32]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[33]  Ling Qiu,et al.  UAV-Enabled Wireless Power Transfer with Directional Antenna: A Two-User Case (Invited Paper) , 2018, 2018 15th International Symposium on Wireless Communication Systems (ISWCS).

[34]  Pieter Abbeel,et al.  An Algorithmic Perspective on Imitation Learning , 2018, Found. Trends Robotics.

[35]  Qingqing Wu,et al.  Energy Tradeoff in Ground-to-UAV Communication via Trajectory Design , 2017, IEEE Transactions on Vehicular Technology.

[36]  Qingqing Wu,et al.  Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks , 2017, IEEE Transactions on Wireless Communications.

[37]  Dimitris A. Pados,et al.  Airborne Cognitive Networking: Design, Development, and Deployment , 2018, IEEE Access.

[38]  Rui Zhang,et al.  Blocking Probability and Spatial Throughput Characterization for Cellular-Enabled UAV Network with Directional Antenna , 2017, ArXiv.

[39]  Yuanzhi Li,et al.  Convergence Analysis of Two-layer Neural Networks with ReLU Activation , 2017, NIPS.

[40]  Rui Zhang,et al.  Energy-Efficient UAV Communication With Trajectory Optimization , 2016, IEEE Transactions on Wireless Communications.

[41]  Yu Tian.  Hybrid VTOL fixed-wing drone , 2017 .

[42]  Ian F. Akyildiz,et al.  Help from the Sky: Leveraging UAVs for Disaster Management , 2017, IEEE Pervasive Computing.

[43]  Amr Rizk,et al.  Queue-aware uplink scheduling with stochastic guarantees , 2016, Comput. Commun..

[44]  Erik Blasch,et al.  Context-Enhanced Information Fusion: Boosting Real-World Performance with Domain Knowledge , 2016 .

[45]  Tarik Taleb,et al.  A green strategic activity scheduling for UAV networks: A sub-modular game perspective , 2016, IEEE Communications Magazine.

[46]  Walid Saad,et al.  Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs , 2015, IEEE Transactions on Wireless Communications.

[47]  Antti Toskala,et al.  LTE Small Cell Optimization: 3GPP Evolution to Release 13 , 2015 .

[48]  R. Jansen,et al.  Songbird - AN Innovative Uas Combining the Advantages of Fixed Wing and Multi Rotor Uas , 2015 .

[49]  Amr Rizk,et al.  Queue-aware uplink scheduling: Analysis, implementation, and evaluation , 2015, 2015 IFIP Networking Conference (IFIP Networking).

[50]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[51]  Arafat J. Al-Dweik,et al.  QoS-Aware Power-Efficient Scheduler for LTE Uplink , 2014, IEEE Transactions on Mobile Computing.

[52]  Elias Yaacoub,et al.  A practical approach for base station on/off switching in green LTE-A HetNets , 2014, 2014 IEEE 10th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[53]  Christian Wietfeld,et al.  Ad hoc self-healing of OFDMA networks using UAV-based relays , 2013, Ad Hoc Networks.

[54]  Swetha,et al.  Performance Evaluation of Round Robin and Proportional Fair Scheduling Algorithms for Constant Bit Rate Traffic in LTE , 2013 .

[55]  Giuseppe Piro,et al.  Downlink Packet Scheduling in LTE Cellular Networks: Key Design Issues and a Survey , 2013, IEEE Communications Surveys & Tutorials.

[56]  Genshe Chen,et al.  Wide-area motion imagery (WAMI) exploitation tools for enhanced situation awareness , 2012, 2012 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[57]  Ming Lei,et al.  Backhaul resource allocation in LTE-Advanced relaying systems , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[58]  Pierre Valin,et al.  Information fusion measures of effectiveness (MOE) for decision support , 2011, Defense + Commercial Sensing.

[59]  Pieter Abbeel,et al.  Autonomous Helicopter Aerobatics through Apprenticeship Learning , 2010, Int. J. Robotics Res..

[60]  자그딥 신그 알루와리아.  Buffer status reporting , 2008 .

[61]  Dan Shen,et al.  A Game Theoretic Data Fusion Aided Path Planning Approach for Cooperative UAV ISR , 2008, 2008 IEEE Aerospace Conference.

[62]  Erik P. Blasch,et al.  Fusion metrics for dynamic situation analysis , 2004, SPIE Defense + Commercial Sensing.

[63]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .