Towards Energy-Aware Federated Traffic Prediction for Cellular Networks

Cellular traffic prediction is a crucial activity for optimizing networks in fifth-generation (5G) networks and beyond, as accurate forecasting is essential for intelligent network design, resource allocation and anomaly mitigation. Although machine learning (ML) is a promising approach to effectively predict network traffic, the centralization of massive data in a single data center raises issues regarding confidentiality, privacy and data transfer demands. To address these challenges, federated learning (FL) emerges as an appealing ML training framework which offers high accurate predictions through parallel distributed computations. However, the environmental impact of these methods is often overlooked, which calls into question their sustainability. In this paper, we address the trade-off between accuracy and energy consumption in FL by proposing a novel sustainability indicator that allows assessing the feasibility of ML models. Then, we comprehensively evaluate state-of-the-art deep learning (DL) architectures in a federated scenario using real-world measurements from base station (BS) sites in the area of Barcelona, Spain. Our findings indicate that larger ML models achieve marginally improved performance but have a significant environmental impact in terms of carbon footprint, which make them impractical for real-world applications.

[1]  P. Efraimidis,et al.  Federated Learning for 5G Base Station Traffic Forecasting , 2022, Comput. Networks.

[2]  M. Miozzo,et al.  The Cost of Training Machine Learning Models Over Distributed Data Sources , 2022, IEEE Open Journal of the Communications Society.

[3]  Ming Ai,et al.  Regional-union based federated learning for wireless traffic prediction in 5G-Advanced/6G network , 2022, 2022 IEEE/CIC International Conference on Communications in China (ICCC Workshops).

[4]  David Martens,et al.  How sustainable is "common" data science in terms of power consumption? , 2022, Sustain. Comput. Informatics Syst..

[5]  B. Shihada,et al.  Efficient Wireless Traffic Prediction at the Edge: A Federated Meta-Learning Approach , 2022, IEEE Communications Letters.

[6]  M. Bennis,et al.  An Energy and Carbon Footprint Analysis of Distributed and Federated Learning , 2022, IEEE Transactions on Green Communications and Networking.

[7]  L. Zhang,et al.  Are Transformers Effective for Time Series Forecasting? , 2022, AAAI.

[8]  Carole-Jean Wu,et al.  Sustainable AI: Environmental Implications, Challenges and Opportunities , 2021, MLSys.

[9]  Mérouane Debbah,et al.  Forecasting Mobile Traffic to Achieve Greener 5G Networks: When Machine Learning is Key , 2021, 2021 IEEE 22nd International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[10]  P. Efraimidis,et al.  Federated Neural Collaborative Filtering , 2021, Knowl. Based Syst..

[11]  Mohamed-Slim Alouini,et al.  Dual Attention-Based Federated Learning for Wireless Traffic Prediction , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[12]  Matías Toril,et al.  A Deep-Learning Model for Estimating the Impact of Social Events on Traffic Demand on a Cell Basis , 2021, IEEE Access.

[13]  Saemundur O. Haraldsson,et al.  Exploring the Accuracy – Energy Trade-off in Machine Learning , 2021, 2021 IEEE/ACM International Workshop on Genetic Improvement (GI).

[14]  Roberto Riggio,et al.  Centralized and Federated Learning for Predictive VNF Autoscaling in Multi-Domain 5G Networks and Beyond , 2021, IEEE Transactions on Network and Service Management.

[15]  Aimee Robbins-Van Wynsberghe,et al.  Sustainable AI: AI for sustainability and the sustainability of AI , 2021, AI and Ethics.

[16]  M. Attaran The impact of 5G on the evolution of intelligent automation and industry digitization , 2021, Journal of Ambient Intelligence and Humanized Computing.

[17]  G. M. Raj,et al.  5G in healthcare: how fast will be the transformation? , 2020, Irish Journal of Medical Science (1971 -).

[18]  Rajiv Misra,et al.  Deep-Learning Based Mobile-Traffic Forecasting for Resource Utilization in 5G Network Slicing , 2020, Advances in Intelligent Systems and Computing.

[19]  Albert Y. Zomaya,et al.  Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence , 2019, IEEE Internet of Things Journal.

[20]  Noah A. Smith,et al.  Green AI , 2019, 1907.10597.

[21]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[22]  Xu Chen,et al.  Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing , 2019, Proceedings of the IEEE.

[23]  A. Lèbre,et al.  Estimating Energy Consumption of Cloud, Fog, and Edge Computing Infrastructures , 2019, IEEE Transactions on Sustainable Computing.

[24]  Tarik Taleb,et al.  On Enabling 5G Automotive Systems Using Follow Me Edge-Cloud Concept , 2018, IEEE Transactions on Vehicular Technology.

[25]  Paul Patras,et al.  Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networks , 2017, MobiHoc.

[26]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[27]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[28]  Marco De Nadai,et al.  A multi-source dataset of urban life in the city of Milan and the Province of Trentino , 2015, Scientific Data.

[29]  Junchi Yan,et al.  Crossformer: Transformer Utilizing Cross-Dimension Dependency for Multivariate Time Series Forecasting , 2023, ICLR.

[30]  Marco Miozzo,et al.  Distributed and Multi-Task Learning at the Edge for Energy Efficient Radio Access Networks , 2021, IEEE Access.