Semi-asynchronous Hierarchical Federated Learning for Cooperative Intelligent Transportation Systems

Cooperative Intelligent Transport System (C-ITS) is a promising network to provide safety, efficiency, sustainability, and comfortable services for automated vehicles and road infrastructures by taking advantages from participants. However, the components of C-ITS usually generate large amounts of data, which makes it difficult to explore data science. Currently, federated learning has been proposed as an appealing approach to allow users to cooperatively reap the benefits from trained participants. Therefore, in this paper, we propose a novel Semi-asynchronous Hierarchical Federated Learning (SHFL) framework for C-ITS that enables elastic edge to cloud model aggregation from data sensing. We further formulate a joint edge node association and resource allocation problem under the proposed SHFL framework to prevent personalities of heterogeneous road vehicles and achieve communication-efficiency. To deal with our proposed Mixed integer nonlinear programming (MINLP) problem, we introduce a distributed Alternating Direction Method of Multipliers (ADMM)-Block Coordinate Update (BCU) algorithm. With this algorithm, a tradeoff between training accuracy and transmission latency has been derived. Numerical results demonstrate the advantages of the proposed algorithm in terms of training overhead and model performance.

[1]  Massimo Tivoli,et al.  Cooperative Intelligent Transport Systems: Choreography-Based Urban Traffic Coordination , 2021, IEEE Transactions on Intelligent Transportation Systems.

[2]  Liang Liu,et al.  Federated Sensing: Edge-Cloud Elastic Collaborative Learning for Intelligent Sensing , 2021, IEEE Internet of Things Journal.

[3]  Guanding Yu,et al.  Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System , 2020, IEEE Transactions on Vehicular Technology.

[4]  Huzefa Rangwala,et al.  Asynchronous Online Federated Learning for Edge Devices with Non-IID Data , 2019, 2020 IEEE International Conference on Big Data (Big Data).

[5]  H. Vincent Poor,et al.  Scheduling Policies for Federated Learning in Wireless Networks , 2019, IEEE Transactions on Communications.

[6]  Tianyi Ma,et al.  Efficient and Robust Asynchronous Federated Learning with Stragglers , 2019, ICLR 2019.

[7]  Joonhyuk Kang,et al.  Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data , 2019, 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC).

[8]  Marco Scavuzzo,et al.  Asynchronous Federated Learning for Geospatial Applications , 2018, DMLE/IOTSTREAMING@PKDD/ECML.

[9]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[10]  Liuqing Yang,et al.  Intelligent transportation spaces: vehicles, traffic, communications, and beyond , 2010, IEEE Communications Magazine.

[11]  Lei Chen,et al.  Cooperative ITS — EU standards to accelerate cooperative mobility , 2014, 2014 International Conference on Connected Vehicles and Expo (ICCVE).

[12]  Elyes Ben Hamida,et al.  On the Interrelation of Security, QoS, and Safety in Cooperative ITS , 2017, IEEE Transactions on Intelligent Transportation Systems.

[13]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Indranil Gupta,et al.  Asynchronous Federated Optimization , 2019, ArXiv.

[16]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[17]  Elyes Ben Hamida,et al.  Security of Cooperative Intelligent Transport Systems: Standards, Threats Analysis and Cryptographic Countermeasures , 2015 .

[18]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[19]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[20]  Qiong Wu,et al.  HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning , 2020, IEEE Transactions on Wireless Communications.

[21]  Masahiro Morikura,et al.  Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data , 2020, ArXiv.

[22]  Ameet Talwalkar,et al.  Federated Multi-Task Learning , 2017, NIPS.

[23]  Walid Saad,et al.  Energy Efficient Federated Learning Over Wireless Communication Networks , 2019, IEEE Transactions on Wireless Communications.

[24]  Ai-Chun Pang,et al.  Semisupervised Distributed Learning With Non-IID Data for AIoT Service Platform , 2020, IEEE Internet of Things Journal.

[25]  Peter Richtárik,et al.  Federated Optimization: Distributed Machine Learning for On-Device Intelligence , 2016, ArXiv.

[26]  Meikang Qiu,et al.  Topological Graph Convolutional Network-Based Urban Traffic Flow and Density Prediction , 2021, IEEE Transactions on Intelligent Transportation Systems.

[27]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[28]  Hubert Eichner,et al.  Federated Learning for Mobile Keyboard Prediction , 2018, ArXiv.

[29]  Lajos Hanzo,et al.  Joint Design of Beam Selection and Precoding Matrices for mmWave MU-MIMO Systems Relying on Lens Antenna Arrays , 2018, IEEE Journal of Selected Topics in Signal Processing.