Machine learning techniques in internet of UAVs for smart cities applications

Recently, there were much interest in technology which has emerged greatly to the development of smart unmanned systems. Internet of UAV (IoUAV) enables an unmanned aerial vehicle (UAV) to connect with public network, and cooperate with the neighboring environment. It also enables UAV to argument information and gather data about others UAV and infrastructures. Applications related to smart UAV and IoUAV systems are facing many impairments issues. The challenges are related to UAV cloud network, big data processing, energy efficiency in IoUAV, and efficient communication between a large amount of different UAV types, in addition to optimum decisions for intelligence. Artificial Intelligence (AI) technologies such as Machine Learning (ML) mechanisms enable to archives intelligent behavior for unmanned systems. Moreover, it provides a smart solution to enhance IoUAV network efficiency. Decisions in data processing are considered one of the most problematic issues related to UAV especially for the operations related to cloud and fog based network levels. ML enables to resolve some of these issues and optimize the Quality of UAV network experience (QoE). The paper provides theoretical fundamentals for ML models and algorithms for IoUAV applications and recently related works, in addition to future trends.

[1]  T. Davenport,et al.  The potential for artificial intelligence in healthcare , 2019, Future Healthcare Journal.

[2]  H. Y. Lee,et al.  Deep Learning-based Monocular Obstacle Avoidance for Unmanned Aerial Vehicle Navigation in Tree Plantations , 2020, Journal of Intelligent & Robotic Systems.

[3]  Xiaoyu Hu,et al.  Research on a Single-Tree Point Cloud Segmentation Method Based on UAV Tilt Photography and Deep Learning Algorithm , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Tom Bassindale,et al.  An investigation into the effect of surveillance drones on textile evidence at crime scenes. , 2017, Science & justice : journal of the Forensic Science Society.

[5]  Manju Khari,et al.  A Deep Learning Model Based on Multi-Objective Particle Swarm Optimization for Scene Classification in Unmanned Aerial Vehicles , 2020, IEEE Access.

[6]  Marek Wojtyra,et al.  Real World Object Detection Dataset for Quadcopter Unmanned Aerial Vehicle Detection , 2020, IEEE Access.

[7]  Fatma Outay,et al.  Applications of unmanned aerial vehicle (UAV) in road safety, traffic and highway infrastructure management: Recent advances and challenges , 2020, Transportation Research Part A: Policy and Practice.

[8]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[9]  Nan Cheng,et al.  Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks , 2020, IEEE Internet of Things Journal.

[10]  Ming Chang,et al.  Bidimensional Empirical Mode Decomposition for SAR Image Feature Extraction With Application to Target Recognition , 2019, IEEE Access.

[11]  Zhu Han,et al.  Millimeter-Wave Networking in the Sky: A Machine Learning and Mean Field Game Approach for Joint Beamforming and Beam-Steering , 2020, IEEE Transactions on Wireless Communications.

[12]  Anis Koubaa,et al.  Drone Deep Reinforcement Learning: A Review , 2021, Electronics.

[13]  Anis Koubaa,et al.  DeepBrain: Experimental Evaluation of Cloud-Based Computation Offloading and Edge Computing in the Internet-of-Drones for Deep Learning Applications , 2020, Sensors.

[14]  Tiago M. Fernández-Caramés,et al.  A Review on IoT Deep Learning UAV Systems for Autonomous Obstacle Detection and Collision Avoidance , 2019, Remote. Sens..

[15]  Manju Khari,et al.  Fine-Tuned Residual Network-Based Features With Latent Variable Support Vector Machine-Based Optimal Scene Classification Model for Unmanned Aerial Vehicles , 2020, IEEE Access.

[16]  Chi Harold Liu,et al.  Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach , 2018, IEEE Journal on Selected Areas in Communications.

[17]  Xukun Shen,et al.  Large-Scale Synthetic Urban Dataset for Aerial Scene Understanding , 2020, IEEE Access.

[18]  Giacinto Gelli,et al.  On the Application of Machine Learning to the Design of UAV-Based 5G Radio Access Networks , 2020, Electronics.

[19]  Eleni I. Vlahogianni,et al.  Identifying Predictable Patterns in the Unconventional Overtaking Decisions of PTW for Cooperative ITS , 2018, IEEE Transactions on Intelligent Vehicles.

[20]  Akio Namiki,et al.  Autonomous Target Tracking of UAV Using High-Speed Visual Feedback , 2019 .

[21]  Mehdi Bennis,et al.  Remote UAV Online Path Planning via Neural Network-Based Opportunistic Control , 2019, IEEE Wireless Communications Letters.

[22]  Nikolaos Nomikos,et al.  A Survey on Machine-Learning Techniques for UAV-Based Communications , 2019, Sensors.

[23]  Zhen Gao,et al.  Codeword Selection for Concurrent Transmissions in UAV Networks: A Machine Learning Approach , 2020, IEEE Access.

[24]  Farid Melgani,et al.  Convolutional SVM Networks for Object Detection in UAV Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Hao Meng,et al.  A 5G Beam Selection Machine Learning Algorithm for Unmanned Aerial Vehicle Applications , 2020, Wirel. Commun. Mob. Comput..

[26]  Jian Liu,et al.  Robust proactive eavesdropping in UAV-enabled wireless communication networking , 2019, EURASIP J. Wirel. Commun. Netw..

[27]  F. Wu,et al.  Cellular UAV-to-Device Communications: Trajectory Design and Mode Selection by Multi-Agent Deep Reinforcement Learning , 2020, IEEE Transactions on Communications.

[28]  Liping Yang,et al.  Detection of Asphalt Pavement Potholes and Cracks Based on the Unmanned Aerial Vehicle Multispectral Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Hui Zhang,et al.  Frontier Progress of Unmanned Aerial Vehicles Optical Wireless Technologies , 2020, Sensors.

[30]  Changchuan Yin,et al.  Optimized Trajectory Design in UAV Based Cellular Networks for 3D Users: A Double Q-Learning Approach , 2019, J. Commun. Inf. Networks.

[31]  Ruben Martinez-Cantin,et al.  Funneled Bayesian Optimization for Design, Tuning and Control of Autonomous Systems , 2016, IEEE Transactions on Cybernetics.

[32]  Christos Grecos,et al.  Hashing Nets for Hashing: A Quantized Deep Learning to Hash Framework for Remote Sensing Image Retrieval , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Mohsen Guizani,et al.  Design Challenges of Multi-UAV Systems in Cyber-Physical Applications: A Comprehensive Survey and Future Directions , 2018, IEEE Communications Surveys & Tutorials.

[34]  Thomas Lagkas,et al.  UAV IoT Framework Views and Challenges: Towards Protecting Drones as “Things” , 2018, Sensors.

[35]  Weidong Wu,et al.  Coupling Deep Learning and UAV for Infrastructure Condition Assessment Automation , 2018, 2018 IEEE International Smart Cities Conference (ISC2).

[36]  Chuan-Yu Chang,et al.  An AIoT Based Smart Agricultural System for Pests Detection , 2020, IEEE Access.

[37]  Amir Alipour-Fanid,et al.  Machine Learning-Based Delay-Aware UAV Detection and Operation Mode Identification Over Encrypted Wi-Fi Traffic , 2019, IEEE Transactions on Information Forensics and Security.

[38]  Abbas Jamalipour,et al.  Machine Learning Inspired Sound-Based Amateur Drone Detection for Public Safety Applications , 2019, IEEE Transactions on Vehicular Technology.

[39]  Fumihide Kojima,et al.  Machine Learning-Based Field Data Analysis and Modeling for Drone Communications , 2019, IEEE Access.

[40]  Carlos E. Otero,et al.  Machine-Learning and 3D Point-Cloud Based Signal Power Path Loss Model for the Deployment of Wireless Communication Systems , 2019, IEEE Access.

[41]  Giuseppina Piscitelli,et al.  Artificial Intelligence and Machine Learning Applications in Smart Production: Progress, Trends, and Directions , 2020 .

[42]  Peng Ren,et al.  A Vision-Aided Approach to Perching a Bioinspired Unmanned Aerial Vehicle , 2018, IEEE Transactions on Industrial Electronics.

[43]  Giuseppe Pirlo,et al.  Artificial Intelligence Applications to Smart City and Smart Enterprise , 2020, Applied Sciences.

[44]  Zhu Han,et al.  A Prediction-Based Charging Policy and Interference Mitigation Approach in the Wireless Powered Internet of Things , 2019, IEEE Journal on Selected Areas in Communications.

[45]  Feng Lyu,et al.  Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach , 2019, IEEE Journal on Selected Areas in Communications.

[46]  Chunmei Xu,et al.  An Overview of Intelligent Wireless Communications using Deep Reinforcement Learning , 2019, J. Commun. Inf. Networks.

[47]  J. Al-Jaroodi,et al.  Unmanned aerial vehicles applications in future smart cities , 2020 .

[48]  Nan Zhao,et al.  Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks , 2020, IEEE Access.

[49]  Guoru Ding,et al.  Dynamic Spectrum Interaction of UAV Flight Formation Communication With Priority: A Deep Reinforcement Learning Approach , 2020, IEEE Transactions on Cognitive Communications and Networking.

[50]  Yu Wang,et al.  LightAMC: Lightweight Automatic Modulation Classification via Deep Learning and Compressive Sensing , 2020, IEEE Transactions on Vehicular Technology.

[51]  Walid Saad,et al.  Echo-Liquid State Deep Learning for 360° Content Transmission and Caching in Wireless VR Networks With Cellular-Connected UAVs , 2018, IEEE Transactions on Communications.

[52]  Raphael Canals,et al.  CRowNet: Deep Network for Crop Row Detection in UAV Images , 2020, IEEE Access.

[53]  Jaime Lloret,et al.  DronAway: A Proposal on the Use of Remote Sensing Drones as Mobile Gateway for WSN in Precision Agriculture , 2020 .

[54]  Akashdeep,et al.  SMART SURVEILLANCE USING ON CLOUD MACHINE LEARNING AND INTERNET CONTROLLED UAVS , 2020 .

[55]  Qing Wang,et al.  Object-Based Land-Cover Supervised Classification for Very-High-Resolution UAV Images Using Stacked Denoising Autoencoders , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Lea Skorin-Kapov,et al.  Survey and Challenges of QoE Management Issues in Wireless Networks , 2013, J. Comput. Networks Commun..

[57]  Yu Zhang,et al.  An Automatic Detection Method of Bird’s Nest on Transmission Line Tower Based on Faster_RCNN , 2020, IEEE Access.

[58]  Walid Saad,et al.  Beyond 5G With UAVs: Foundations of a 3D Wireless Cellular Network , 2018, IEEE Transactions on Wireless Communications.

[59]  Walid Saad,et al.  A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems , 2018, IEEE Communications Surveys & Tutorials.

[60]  Robert Jenssen,et al.  Intelligent Monitoring and Inspection of Power Line Components Powered by UAVs and Deep Learning , 2019, IEEE Power and Energy Technology Systems Journal.

[61]  De Xu,et al.  Robust Visual Detection–Learning–Tracking Framework for Autonomous Aerial Refueling of UAVs , 2016, IEEE Transactions on Instrumentation and Measurement.

[62]  Jongdae Baek,et al.  Impedance-Based Non-Destructive Testing Method Combined with Unmanned Aerial Vehicle for Structural Health Monitoring of Civil Infrastructures , 2016 .

[63]  Asharul Islam Khan,et al.  Unmanned Aerial Vehicle in the Machine Learning Environment , 2019, EUSPN/ICTH.

[64]  Frederic Maire,et al.  UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments , 2020, Remote. Sens..

[65]  Farid Melgani,et al.  Spatial and Structured SVM for Multilabel Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Shengyong Chen,et al.  Evolutionary Collaborative Human-UAV Search for Escaped Criminals , 2020, IEEE Transactions on Evolutionary Computation.

[67]  Wei-Chiang Hong,et al.  Machine Learning Adoption in Blockchain-Based Smart Applications: The Challenges, and a Way Forward , 2020, IEEE Access.

[68]  Vuk Marojevic,et al.  3D Spectrum Sharing for Hybrid D2D and UAV Networks , 2020, IEEE Transactions on Communications.

[69]  Tor Arne Johansen,et al.  A Machine Learning Approach for Estimating Air Data Parameters of Small Fixed-Wing UAVs Using Distributed Pressure Sensors , 2020, IEEE Transactions on Aerospace and Electronic Systems.

[70]  Mohammed Rabah,et al.  Convolutional Neural Network-Based Real-Time Object Detection and Tracking for Parrot AR Drone 2 , 2019, IEEE Access.

[71]  S. H. Alsamhi,et al.  Survey on Collaborative Smart Drones and Internet of Things for Improving Smartness of Smart Cities , 2019, IEEE Access.

[72]  Jason J. Ford,et al.  Learning to Detect Aircraft for Long-Range Vision-Based Sense-and-Avoid Systems , 2018, IEEE Robotics and Automation Letters.

[73]  Arijit Raychowdhury,et al.  A 65-nm 8-to-3-b 1.0–0.36-V 9.1–1.1-TOPS/W Hybrid-Digital-Mixed-Signal Computing Platform for Accelerating Swarm Robotics , 2020, IEEE Journal of Solid-State Circuits.

[74]  Farid Melgani,et al.  CSVM Architectures for Pixel-Wise Object Detection in High-Resolution Remote Sensing Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[75]  Jun Zhao,et al.  Sum-Rate Maximization for UAV-Assisted Visible Light Communications Using NOMA: Swarm Intelligence Meets Machine Learning , 2020, IEEE Internet of Things Journal.

[76]  Anshuman Bhardwaj,et al.  Applications of Unmanned Aerial Vehicles in Cryosphere: Latest Advances and Prospects , 2020, Remote. Sens..

[77]  Walid Saad,et al.  Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks , 2018, IEEE Transactions on Wireless Communications.

[78]  Abhimanyu S. Ahuja,et al.  The impact of artificial intelligence in medicine on the future role of the physician , 2019, PeerJ.

[79]  Lifang Yang,et al.  Recurrent MADDPG for Object Detection and Assignment in Combat Tasks , 2020, IEEE Access.

[80]  Sotirios K. Goudos,et al.  Application of an Ensemble Method to UAV Power Modeling for Cellular Communications , 2019, IEEE Antennas and Wireless Propagation Letters.

[81]  Wenbo Ma,et al.  State of charge prediction for UAVs based on support vector machine , 2019, The Journal of Engineering.

[82]  Abdulhadi Shoufan,et al.  Drone Pilot Identification by Classifying Radio-Control Signals , 2018, IEEE Transactions on Information Forensics and Security.

[83]  Bo Xu,et al.  A Basal Ganglia Network Centric Reinforcement Learning Model and Its Application in Unmanned Aerial Vehicle , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[84]  Chao Yu,et al.  Supervised-actor-critic reinforcement learning for intelligent mechanical ventilation and sedative dosing in intensive care units , 2020, BMC Medical Informatics and Decision Making.

[85]  Zunwen He,et al.  A Two-Step Environment-Learning-Based Method for Optimal UAV Deployment , 2019, IEEE Access.

[86]  Romualdas Navickas,et al.  Review of V2X–IoT Standards and Frameworks for ITS Applications , 2020, Applied Sciences.

[87]  Lammert Kooistra,et al.  Fast Classification of Large Germinated Fields Via High-Resolution UAV Imagery , 2019, IEEE Robotics and Automation Letters.

[88]  Xiao Liu,et al.  Trajectory Design and Power Control for Multi-UAV Assisted Wireless Networks: A Machine Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[89]  Xue Xia,et al.  IADRL: Imitation Augmented Deep Reinforcement Learning Enabled UGV-UAV Coalition for Tasking in Complex Environments , 2020, IEEE Access.

[90]  Farshid Safari,et al.  Using Clustering Methods in Multinomial Logit Model for Departure Time Choice , 2020 .

[91]  Trung Q. Duong,et al.  Detection of Eavesdropping Attack in UAV-Aided Wireless Systems: Unsupervised Learning With One-Class SVM and K-Means Clustering , 2020, IEEE Wireless Communications Letters.

[92]  Qasim Zeeshan,et al.  Machine Learning in Predictive Maintenance towards Sustainable Smart Manufacturing in Industry 4.0 , 2020, Sustainability.

[93]  Naif Alajlan,et al.  Efficient Framework for Palm Tree Detection in UAV Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[94]  Martins Ezuma,et al.  Detection and Classification of UAVs Using RF Fingerprints in the Presence of Wi-Fi and Bluetooth Interference , 2020, IEEE Open Journal of the Communications Society.

[95]  Gaojie Chen,et al.  Trusted UAV Network Coverage Using Blockchain, Machine Learning, and Auction Mechanisms , 2020, IEEE Access.