Matching Game With No-Regret Learning for IoT Energy-Efficient Associations With UAV

Unmanned aerial vehicles (UAVs) are a promising technology to provide an energy-efficient and cost-effective solution for data collection from ground Internet of Things (IoT) network. In this paper, we analyze the UAV-IoT device associations that provide reliable connections with low communication power and load balance the traffic using analytical techniques from game theory. In particular, to maximize the IoT devices’ benefits, a novel framework is proposed to assign them the most suitable UAVs. We formulate the problem as a distributed algorithm that combines notions from matching theory and no-regret learning. First, we develop a many-to-one matching game where UAVs and IoT devices are the players. In this subgame, the players rank one another based on individual utility functions that capture their needs. Each IoT device aims to minimize its transmitting energy while meeting its signal-to-interference-plus-noise-ratio (SINR) requirements, and each UAV seeks to maximize the number of served IoT devices while respecting its energy constraints. Second, a non-cooperative game based on no-regret learning is used to determine each IoT device’s regret. Then, UAVs open a window for transfers to the IoT devices. Simulation results show that the proposed approach provides a low average total transmit power, ensures fast data transmission and optimal utilization of the UAVs’ bandwidth.

[1]  Walid Saad,et al.  Efficient Deployment of Multiple Unmanned Aerial Vehicles for Optimal Wireless Coverage , 2016, IEEE Communications Letters.

[2]  Fei Huang,et al.  Multiple-UAV-Assisted SWIPT in Internet of Things: User Association and Power Allocation , 2019, IEEE Access.

[3]  Xianwei Zhou,et al.  Resource Allocation in Unmanned Aerial Vehicle (UAV)-Assisted Wireless-Powered Internet of Things , 2019, Sensors.

[4]  Halim Yanikomeroglu,et al.  Efficient 3-D placement of an aerial base station in next generation cellular networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[5]  Kandeepan Sithamparanathan,et al.  Optimal LAP Altitude for Maximum Coverage , 2014, IEEE Wireless Communications Letters.

[6]  Walid Saad,et al.  Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications , 2017, IEEE Transactions on Wireless Communications.

[7]  Jiajia Liu,et al.  UAV-Enhanced Intelligent Offloading for Internet of Things at the Edge , 2020, IEEE Transactions on Industrial Informatics.

[8]  Alagan Anpalagan,et al.  Self-Organizing Relay Selection in UAV Communication Networks: A Matching Game Perspective , 2018, IEEE Wireless Communications.

[9]  Halima Elbiaze,et al.  Performance Analysis of UAV-assisted Ferrying for the Internet of Things , 2019, 2019 IEEE Symposium on Computers and Communications (ISCC).

[10]  L. S. Shapley,et al.  College Admissions and the Stability of Marriage , 2013, Am. Math. Mon..

[11]  Kai-Kit Wong,et al.  Minimum Throughput Maximization for Multi-UAV Enabled WPCN: A Deep Reinforcement Learning Method , 2020, IEEE Access.

[12]  Bill N. Schilit,et al.  Enabling the Internet of Things , 2015, Computer.

[13]  Walid Saad,et al.  Mobile Internet of Things: Can UAVs Provide an Energy-Efficient Mobile Architecture? , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[14]  Laurie G. Cuthbert,et al.  Energy-Efficient UAV Communication with Multiple GTs Based on Trajectory Optimization , 2018, Mob. Inf. Syst..

[15]  Miao Pan,et al.  Efficient data collection for wireless rechargeable sensor clusters in Harsh terrains using UAVs , 2014, 2014 IEEE Global Communications Conference.

[16]  Ying-Chang Liang,et al.  Deep Reinforcement Learning for Channel and Power Allocation in UAV-enabled IoT Systems , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[17]  Guoru Ding,et al.  Maximization of Data Dissemination in UAV-Supported Internet of Things , 2019, IEEE Wireless Communications Letters.

[18]  Kerstin Eder,et al.  The IoT Energy Challenge: A Software Perspective , 2018, IEEE Embedded Systems Letters.

[19]  Zhu Han,et al.  UAV-Assisted Wireless Charging for Energy-Constrained IoT Devices Using Dynamic Matching , 2020, IEEE Internet of Things Journal.

[20]  Tarik Taleb,et al.  Low-Altitude Unmanned Aerial Vehicles-Based Internet of Things Services: Comprehensive Survey and Future Perspectives , 2016, IEEE Internet of Things Journal.

[21]  Cheng Zhan,et al.  Energy Minimization in Internet-of-Things System Based on Rotary-Wing UAV , 2019, IEEE Wireless Communications Letters.

[22]  A. Roth,et al.  Two-sided matching , 1990 .

[23]  Yijun Liu,et al.  Trajectory Optimization and Power Allocation for Multi-Hop UAV Relaying Communications , 2018, IEEE Access.

[24]  Jalel Ben-Othman,et al.  UAV for Energy-Efficient IoT Communications: Matching Game Approach , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[25]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[26]  Walid Saad,et al.  A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems , 2018, IEEE Communications Surveys & Tutorials.

[27]  K. R. Venugopal,et al.  Searching for the IoT Resources: Fundamentals, Requirements, Comprehensive Review, and Future Directions , 2018, IEEE Communications Surveys & Tutorials.

[28]  Bin Jiang,et al.  Multimedia Data Throughput Maximization in Internet-of-Things System Based on Optimization of Cache-Enabled UAV , 2019, IEEE Internet of Things Journal.

[29]  Walid Saad,et al.  Resource Allocation for Machine-to-Machine Communications with Unmanned Aerial Vehicles , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[30]  Rui Zhang,et al.  Energy-Efficient Data Collection in UAV Enabled Wireless Sensor Network , 2017, IEEE Wireless Communications Letters.

[31]  Ignas G. Niemegeers,et al.  An Analytical Energy Consumption Model for Packet Transfer over Wireless Links , 2012, IEEE Communications Letters.

[32]  Amin Azari,et al.  Self-Organized Low-Power IoT Networks: A Distributed Learning Approach , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[33]  Zhu Han,et al.  Matching Theory: Applications in wireless communications , 2016, IEEE Signal Processing Magazine.

[34]  Walid Saad,et al.  Regret Based Learning for UAV Assisted LTE-U/WiFi Public Safety Networks , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[35]  Jie Xu,et al.  Energy Minimization for Wireless Communication With Rotary-Wing UAV , 2018, IEEE Transactions on Wireless Communications.

[36]  Nader Mokari,et al.  Joint Radio Resource Allocation, 3D Placement and User Association of Aerial Base Stations in IoT Networks , 2017 .

[37]  Jianhua Lu,et al.  UAV-Aided MIMO Communications for 5G Internet of Things , 2019, IEEE Internet of Things Journal.

[38]  Jalel Ben-Othman,et al.  Energy-Efficient Associations for IoT networks with UAV: A Regret Matching Based Approach , 2019, ICICM.

[39]  Jalel Ben-Othman,et al.  Channel Assignment for D2D communication : A Regret Matching Based Approach , 2018, 2018 14th International Wireless Communications & Mobile Computing Conference (IWCMC).

[40]  S. Hart,et al.  A simple adaptive procedure leading to correlated equilibrium , 2000 .