Scalable Markov Decision Process Model for Advanced Sleep Modes Management in 5G Networks

Advanced Sleep Modes (ASM) correspond to a gradual deactivation of the base station's components according to the time needed by each of them to shut down then reactivate again. Each level of sleep has a different power consumption and imposes an extra delay on arriving traffic as it has to wait for the components to wake up and serve it. We present in this work a scalable management strategy of this feature based on Markov Decision Processes (MDP) in order to derive the optimal policy allowing to choose the best sleep level according to the traffic load and to the tradeoff between delay and energy consumption while ensuring a low complexity. Our results show that this solution is very promising and allows to achieve high energy saving (up to 91%) if there is no constraint on the delay, but even with a high constraint, the energy reduction can reach up to 52% while the impact on the delay is negligible.

[1]  Eitan Altman,et al.  Optimal Control of Sleep Periods for Wireless Terminals , 2011, IEEE Journal on Selected Areas in Communications.

[2]  Weihua Zhuang,et al.  A Survey on Green Mobile Networking: From The Perspectives of Network Operators and Mobile Users , 2015, IEEE Communications Surveys & Tutorials.

[3]  Zwi Altman,et al.  Optimal Policies of Advanced Sleep Modes for Energy-Efficient 5G networks , 2019, 2019 IEEE 18th International Symposium on Network Computing and Applications (NCA).

[4]  Gilbert Micallef,et al.  Cell size breathing and possibilities to introduce cell sleep mode , 2010, 2010 European Wireless Conference (EW).

[5]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[6]  Rahim Tafazolli,et al.  Energy-Efficient and Load-Proportional eNodeB for 5G User-Centric Networks: A Multilevel Sleep Strategy Mechanism , 2018, IEEE Vehicular Technology Magazine.

[7]  Harald Haas,et al.  A novel time-domain sleep mode design for energy-efficient LTE , 2010, 2010 4th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[8]  Jens Malmodin,et al.  Reducing Energy Consumption in LTE with Cell DTX , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[11]  Anja Feldmann,et al.  Fitting mixtures of exponentials to long-tail distributions to analyze network performance models , 1997, Proceedings of INFOCOM '97.

[12]  Mohamed-Slim Alouini,et al.  Next-Generation Environment-Aware Cellular Networks: Modern Green Techniques and Implementation Challenges , 2016, IEEE Access.

[13]  Moshe Zukerman,et al.  Energy-Efficient Base-Stations Sleep-Mode Techniques in Green Cellular Networks: A Survey , 2015, IEEE Communications Surveys & Tutorials.

[14]  Panu Lähdekorpi,et al.  Energy efficiency of 5G mobile networks with base station sleep modes , 2017, 2017 IEEE Conference on Standards for Communications and Networking (CSCN).

[15]  Björn Debaillie,et al.  A Flexible and Future-Proof Power Model for Cellular Base Stations , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[16]  H. Vincent Poor,et al.  A Survey of Energy-Efficient Techniques for 5G Networks and Challenges Ahead , 2016, IEEE Journal on Selected Areas in Communications.