Adaptive Resource Allocation Considering Power-Consumption Outage: A Deep Reinforcement Learning Approach

A major feature of mobile devices in the future wireless network is the high data rate. However, the newly proposed power-consumption outage indicates that the heat generated by high data rate devices has an influence on the performance. This correspondence investigates a novel resource allocation scheme considering power-consumption outage. Specifically, based on the analysis of the heat transfer model in the smartphone, we formulate the problem to jointly allocate the downlink power and bandwidth while considering the impact of power-consumption outage. According to the dynamic feature of the problem, the Markov decision process (MDP) is utilized to model it. Furthermore, dut to the continuity of action space, the problem is handled by normalized advantage function (NAF), a deep reinforcement learning (DRL) algorithm. The effectiveness of the proposed scheme is corroborated in the simulation results on the basis of which its applicability for services with different features is further discussed.

[1]  Hamid Gharavi,et al.  Power-Consumption Outage in Beyond Fifth Generation Mobile Communication Systems , 2021, IEEE Transactions on Wireless Communications.

[2]  F. Richard Yu,et al.  QoS Aware Transcoding for Live Streaming in Edge-Clouds Aided HetNets: An Enhanced Actor-Critic Approach , 2019, IEEE Transactions on Vehicular Technology.

[3]  Yuguang Fang,et al.  Offloading Optimization and Bottleneck Analysis for Mobile Cloud Computing , 2019, IEEE Transactions on Communications.

[4]  Ümit Y. Ogras,et al.  Power and Thermal Analysis of Commercial Mobile Platforms: Experiments and Case Studies , 2019, 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[5]  F. Richard Yu,et al.  Joint Offloading and Resource Allocation in Mobile Edge Computing Systems: An Actor-Critic Approach , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[6]  Xiaohu Ge,et al.  How Much of Wireless Rates Can Smartphones Support in 5G Networks? , 2018, IEEE Network.

[7]  Walid Saad,et al.  Echo-Liquid State Deep Learning for 360° Content Transmission and Caching in Wireless VR Networks With Cellular-Connected UAVs , 2018, IEEE Transactions on Communications.

[8]  Suresh V. Garimella,et al.  Electronics Thermal Management in Information and Communications Technologies: Challenges and Future Directions , 2017, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[9]  Shane Legg,et al.  Noisy Networks for Exploration , 2017, ICLR.

[10]  Antti Anttonen,et al.  Why Will Computing Power Need Particular Attention in Future Wireless Devices? , 2017, IEEE Circuits and Systems Magazine.

[11]  Jon Anderson,et al.  A figure of merit for mobile device thermal management , 2016, 2016 15th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm).

[12]  Sergey Levine,et al.  Continuous Deep Q-Learning with Model-based Acceleration , 2016, ICML.