A Discrete-Time Mean Field Game in Multi-UAV Wireless Communication Systems

Unmanned aerial vehicles (UAVs) are foreseen as a promising solution to deal with sophisticated communication scenarios, which can be used as aerial mobile base stations to enhance terrestrial wireless communication systems. Due to the wide range of serviced ground users, a large number of UAVs need to be deployed. In this paper, we study a multi-UAV downlink communication system with the UAVs acting as the aerial mobile base stations, and investigate the probability of successful transmission between the UAV and its served users, with consideration of both energy availability and mobility effects. We propose the optimal control law based on a discrete-time mean field game (MFG) with power control and velocity control. Furthermore, the optimal controls generate an almost surely asymptotic Nash equilibrium according to the estimate of population state average, meaning that the long time average cost reaches its minimum. Simulation results show that the proposed control policy can effectively improve the probability of successful transmission.

[1]  F. Richard Yu,et al.  A mean-field game approach for distributed interference and resource management in heterogeneous cellular networks , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[2]  Ekram Hossain,et al.  Multi-Tier Drone Architecture for 5G/B5G Cellular Networks: Challenges, Trends, and Prospects , 2017, IEEE Communications Magazine.

[3]  Peter E. Caines,et al.  Nash, Social and Centralized Solutions to Consensus Problems via Mean Field Control Theory , 2013, IEEE Transactions on Automatic Control.

[4]  Hamidou Tembine,et al.  Mean field games for cognitive radio networks , 2012, 2012 American Control Conference (ACC).

[5]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[6]  Mehdi Bennis,et al.  Drone Small Cells in the Clouds: Design, Deployment and Performance Analysis , 2014, GLOBECOM 2014.

[7]  P. Caines,et al.  A Solution to the Consensus Problem via Stochastic Mean Field Control , 2010 .

[8]  Emilio Frazzoli,et al.  Decentralised dynamic games for large population stochastic multi-agent systems , 2015 .

[9]  Zhu Han,et al.  Distributed Interference and Energy-Aware Power Control for Ultra-Dense D2D Networks: A Mean Field Game , 2017, IEEE Transactions on Wireless Communications.

[10]  Qingqing Wu,et al.  Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks , 2017, IEEE Transactions on Wireless Communications.

[11]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[12]  Minyi Huang,et al.  Nash Certainty Equivalence in Large Population Stochastic Dynamic Games: Connections with the Physics of Interacting Particle Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[13]  Ekram Hossain,et al.  Downlink Power Control in Self-Organizing Dense Small Cells Underlaying Macrocells: A Mean Field Game , 2016, IEEE Transactions on Mobile Computing.