Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach

Federated learning is a newly emerged distributed machine learning paradigm, where the clients are allowed to individually train local deep neural network (DNN) models with local data and then jointly aggregate a global DNN model at the central server. Vehicular edge computing (VEC) aims at exploiting the computation and communication resources at the edge of vehicular networks. Federated learning in VEC is promising to meet the ever-increasing demands of artificial intelligence (AI) applications in intelligent connected vehicles (ICV). Considering image classification as a typical AI application in VEC, the diversity of image quality and computation capability in vehicular clients potentially affects the accuracy and efficiency of federated learning. Accordingly, we propose a selective model aggregation approach, where “fine” local DNN models are selected and sent to the central server by evaluating the local image quality and computation capability. Regarding the implementation of model selection, the central server is not aware of the image quality and computation capability in the vehicular clients, whose privacy is protected under such a federated learning framework. To overcome this information asymmetry, we employ two-dimension contract theory as a distributed framework to facilitate the interactions between the central server and vehicular clients. The formulated problem is then transformed into a tractable problem through successively relaxing and simplifying the constraints, and eventually solved by a greedy algorithm. Using two datasets, i.e., MNIST and BelgiumTSC, our selective model aggregation approach is demonstrated to outperform the original federated averaging (FedAvg) approach in terms of accuracy and efficiency. Meanwhile, our approach also achieves higher utility at the central server compared with the baseline approaches.

[1]  He Chen,et al.  Incentive Mechanism Design for Wireless Energy Harvesting-Based Internet of Things , 2017, IEEE Internet of Things Journal.

[2]  Huei-Yung Lin,et al.  Vehicle speed detection from a single motion blurred image , 2008, Image Vis. Comput..

[3]  Bishwaranjan Bhattacharjee,et al.  Automatic Labeling of Data for Transfer Learning , 2019, CVPR Workshops.

[4]  Guanding Yu,et al.  Accelerating DNN Training in Wireless Federated Edge Learning Systems , 2019, IEEE Journal on Selected Areas in Communications.

[5]  Kun Jiang,et al.  Intelligent and connected vehicles: Current status and future perspectives , 2018, Science China Technological Sciences.

[6]  Qiang Yang,et al.  Federated Machine Learning , 2019, ACM Trans. Intell. Syst. Technol..

[7]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[8]  Ying-Chang Liang,et al.  Joint Service Pricing and Cooperative Relay Communication for Federated Learning , 2018, 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[9]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[10]  Luc Van Gool,et al.  Multi-view traffic sign detection, recognition, and 3D localisation , 2014, Machine Vision and Applications.

[11]  Feng Zhao,et al.  Parked Vehicular Computing for Energy-Efficient Internet of Vehicles: A Contract Theoretic Approach , 2019, IEEE Internet of Things Journal.

[12]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[13]  Yichao Chen,et al.  An Efficient Incentive Mechanism for Device-to-Device Multicast Communication in Cellular Networks , 2018, IEEE Transactions on Wireless Communications.

[14]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[15]  Hubert Eichner,et al.  Federated Learning for Mobile Keyboard Prediction , 2018, ArXiv.

[16]  Song Wang,et al.  Effects of Image Degradations to CNN-based Image Classification , 2018, ArXiv.

[17]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[18]  Albert Y. Zomaya,et al.  Federated Learning over Wireless Networks: Optimization Model Design and Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[19]  André Kaup,et al.  Robustness of Deep Convolutional Neural Networks for Image Degradations , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Fredrik Tufvesson,et al.  A survey on vehicle-to-vehicle propagation channels , 2009, IEEE Wireless Communications.

[21]  Lei Liu,et al.  Vehicular Edge Computing and Networking: A Survey , 2019, Mobile Networks and Applications.

[22]  Azzedine Boukerche,et al.  Vehicular Cloud: Stochastic Analysis of Computing Resources in a Road Segment , 2015, PE-WASUN '15.

[23]  Yunus Sarikaya,et al.  Motivating Workers in Federated Learning: A Stackelberg Game Perspective , 2019, IEEE Networking Letters.

[24]  Miao Pan,et al.  Offloading in Software Defined Network at Edge with Information Asymmetry: A Contract Theoretical Approach , 2015, J. Signal Process. Syst..

[25]  Min Sheng,et al.  Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling , 2016, IEEE Transactions on Communications.

[26]  Wei Shi,et al.  Federated learning of predictive models from federated Electronic Health Records , 2018, Int. J. Medical Informatics.

[27]  Yan Zhang,et al.  Permissioned Blockchain for Efficient and Secure Resource Sharing in Vehicular Edge Computing , 2019, ArXiv.

[28]  Choong Seon Hong,et al.  A Crowdsourcing Framework for On-Device Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[29]  Jimy Alexander Cortés-Osorio,et al.  Velocity Estimation From a Single Linear Motion Blurred Image Using Discrete Cosine Transform , 2019, IEEE Transactions on Instrumentation and Measurement.