Reinforcement learning approach to dynamic activation of base station resources in wireless networks

Recently, the issue of energy efficiency in wireless networks has attracted much research attention due to the growing concern on global warming and operator's profitability. We focus on energy efficiency of base stations because they account for 80% of total energy consumed in a wireless network. In this paper, we intend to reduce energy consumption of a base station by dynamically activating and deactivating the modular resources at the base station depending on the instantaneous network traffic. We propose an online reinforcement learning algorithm that will continuously adapt to the changing network traffic in deciding which action to take to maximize energy saving. As an online algorithm, the proposed scheme does not require a separate training phase and can be deployed immediately. Simulation results have confirmed that the proposed algorithm can achieve more than 50% energy saving without compromising network service quality which is measured in terms of user blocking probability.

[1]  Holger Claussen,et al.  Effects of joint macrocell and residential picocell deployment on the network energy efficiency , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Gerhard Fettweis,et al.  Energy Efficiency Aspects of Base Station Deployment Strategies for Cellular Networks , 2009, 2009 IEEE 70th Vehicular Technology Conference Fall.

[4]  J.T. Louhi,et al.  Energy efficiency of modern cellular base stations , 2007, INTELEC 07 - 29th International Telecommunications Energy Conference.

[5]  Zhisheng Niu,et al.  Cell zooming for cost-efficient green cellular networks , 2010, IEEE Communications Magazine.

[6]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[7]  Vijay K. Bhargava,et al.  Green Cellular Networks: A Survey, Some Research Issues and Challenges , 2011, IEEE Communications Surveys & Tutorials.

[8]  Tijani Chahed,et al.  Optimal control for base station sleep mode in energy efficient radio access networks , 2011, 2011 Proceedings IEEE INFOCOM.